-
Bug
-
Resolution: Cannot Reproduce
-
Major
-
None
-
Jenkins running on Debian Jessie 8.9 provisioning to Debian Stretch 9.3
Jenkins Java : openjdk version "1.8.0_131"
Agent Java : openjdk version "1.8.0_151"
Jenkins core : Jenkins 2.73.2
Azure VM Agents : Azure VM Agents 0.6.0
Jenkins running directly, not sure about installation.
Chrome : Version 64.0.3282.140 (Official Build) (64-bit)
System properties
awt.toolkit sun.awt.X11.XToolkit
executable-war /usr/share/jenkins/jenkins.war
file.encoding UTF-8
file.encoding.pkg sun.io
file.separator /
java.awt.graphicsenv sun.awt.X11GraphicsEnvironment
java.awt.headless true
java.awt.printerjob sun.print.PSPrinterJob
java.class.path /usr/share/jenkins/jenkins.war
java.class.version 52.0
java.endorsed.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed
java.ext.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext
java.home /usr/lib/jvm/java-8-openjdk-amd64/jre
java.io.tmpdir /tmp
java.library.path /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
java.runtime.name OpenJDK Runtime Environment
java.runtime.version 1.8.0_131-8u131-b11-1~bpo8+1-b11
java.specification.name Java Platform API Specification
java.specification.vendor Oracle Corporation
java.specification.version 1.8
java.vendor Oracle Corporation
java.vendor.url http://java.oracle.com/
java.vendor.url.bug http://bugreport.sun.com/bugreport/
java.version 1.8.0_131
java.vm.info mixed mode
java.vm.name OpenJDK 64-Bit Server VM
java.vm.specification.name Java Virtual Machine Specification
java.vm.specification.vendor Oracle Corporation
java.vm.specification.version 1.8
java.vm.vendor Oracle Corporation
java.vm.version 25.131-b11
jna.loaded true
jna.platform.library.path /usr/lib/x86_64-linux-gnu:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/lib
jnidispatch.path /tmp/jna--1712433994/jna109663947143428543.tmp
line.separator
mail.smtp.sendpartial true
mail.smtps.sendpartial true
os.arch amd64
os.name Linux
os.version 3.16.0-4-amd64
path.separator :
sun.arch.data.model 64
sun.boot.class.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes
sun.boot.library.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64
sun.cpu.endian little
sun.cpu.isalist
sun.font.fontmanager sun.awt.X11FontManager
sun.io.unicode.encoding UnicodeLittle
sun.java.command /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --httpKeepAliveTimeout=60000
sun.java.launcher SUN_STANDARD
sun.jnu.encoding UTF-8
sun.management.compiler HotSpot 64-Bit Tiered Compilers
sun.os.patch.level unknown
svnkit.http.methods Digest,Basic,NTLM,Negotiate
svnkit.ssh2.persistent false
user.country GB
user.dir /
user.home /var/lib/jenkins
user.language en
user.name jenkins
user.timezone Europe/London
Environment Variables
_ /usr/bin/daemon
HOME /var/lib/jenkins
JENKINS_HOME /mnt/jenkins-home
LANG en_GB.UTF-8
LANGUAGE en_GB:en
LOGNAME jenkins
MAIL /var/mail/jenkins
PATH /usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
PWD /var/lib/jenkins
SHELL /bin/bash
SHLVL 1
TERM xterm-256color
USER jenkins
Plugins
ace-editor 1.1 true
ant 1.7 true
antisamy-markup-formatter 1.5 true
apache-httpcomponents-client-4-api 4.5.3-2.0 true
authentication-tokens 1.3 true
azure-commons 0.2.4 true
azure-credentials 1.3.1 true
azure-vm-agents 0.6.0 true
bouncycastle-api 2.16.2 true
branch-api 2.0.15 true
build-alias-setter 0.4 true
build-timeout 1.19 true
cloud-stats 0.16 true
cloudbees-folder 6.2.1 true
conditional-buildstep 1.3.6 true
copyartifact 1.39 true
credentials 2.1.16 true
credentials-binding 1.13 true
disk-usage 0.28 true
display-url-api 2.1.0 true
docker-commons 1.9 true
docker-workflow 1.14 true
durable-task 1.15 true
email-ext 2.61 true
external-monitor-job 1.7 true
ghprb 1.39.1-0-Custom true
git 3.6.4 true
git-client 2.6.0 true
git-server 1.7 true
github 1.28.1 true
github-api 1.90 true
github-branch-source 2.2.6 true
github-oauth 0.28.1 true
github-organization-folder 1.6 true
gradle 1.28 true
groovy 2.0 true
handlebars 1.1.1 true
icon-shim 2.0.3 true
jackson2-api 2.8.7.0 true
javadoc 1.4 true
job-dsl 1.66 true
jobConfigHistory 2.18 true
jquery 1.12.4-0 true
jquery-detached 1.2.1 true
jsch 0.1.54.1 true
junit 1.21 true
ldap 1.17 true
lockable-resources 2.0 true
mailer 1.20 true
mapdb-api 1.0.9.0 true
matrix-auth 2.1.1 true
matrix-project 1.12 true
maven-plugin 3.0 true
metrics 3.1.2.10 true
momentjs 1.1.1 true
msbuild 1.28 true
nodelabelparameter 1.7.2 true
pam-auth 1.3 true
parameterized-trigger 2.35.2 true
pipeline-build-step 2.5.1 true
pipeline-github-lib 1.0 true
pipeline-graph-analysis 1.5 true
pipeline-input-step 2.8 true
pipeline-milestone-step 1.3.1 true
pipeline-model-api 1.2.3 true
pipeline-model-declarative-agent 1.1.1 true
pipeline-model-definition 1.2.3 true
pipeline-model-extensions 1.2.3 true
pipeline-rest-api 2.9 true
pipeline-stage-step 2.3 true
pipeline-stage-tags-metadata 1.2.3 true
pipeline-stage-view 2.9 true
pipeline-utility-steps 1.5.1 true
plain-credentials 1.4 true
PrioritySorter 3.5.1 true
promoted-builds 2.31 true
rebuild 1.27 true
resource-disposer 0.8 true
run-condition 1.0 true
scm-api 2.2.5 true
script-security 1.35 true
ssh-agent 1.15 true
ssh-credentials 1.13 true
ssh-slaves 1.22 true
structs 1.10 true
subversion 2.9 true
throttle-concurrents 2.0.1 true
timestamper 1.8.8 true
token-macro 2.3 true
windows-slaves 1.3.1 true
workflow-aggregator 2.5 true
workflow-api 2.23.1 true
workflow-basic-steps 2.6 true
workflow-cps 2.41 true
workflow-cps-global-lib 2.9 true
workflow-durable-task-step 2.17 true
workflow-job 2.12.2 true
workflow-multibranch 2.16 true
workflow-scm-step 2.6 true
workflow-step-api 2.13 true
workflow-support 2.16 true
ws-cleanup 0.34 true
Jenkins running on Debian Jessie 8.9 provisioning to Debian Stretch 9.3 Jenkins Java : openjdk version "1.8.0_131" Agent Java : openjdk version "1.8.0_151" Jenkins core : Jenkins 2.73.2 Azure VM Agents : Azure VM Agents 0.6.0 Jenkins running directly, not sure about installation. Chrome : Version 64.0.3282.140 (Official Build) (64-bit) System properties awt.toolkit sun.awt.X11.XToolkit executable-war /usr/share/jenkins/jenkins.war file.encoding UTF-8 file.encoding.pkg sun.io file.separator / java.awt.graphicsenv sun.awt.X11GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.print.PSPrinterJob java.class.path /usr/share/jenkins/jenkins.war java.class.version 52.0 java.endorsed.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/endorsed java.ext.dirs /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/ext:/usr/java/packages/lib/ext java.home /usr/lib/jvm/java-8-openjdk-amd64/jre java.io.tmpdir /tmp java.library.path /usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib java.runtime.name OpenJDK Runtime Environment java.runtime.version 1.8.0_131-8u131-b11-1~bpo8+1-b11 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.8 java.vendor Oracle Corporation java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.8.0_131 java.vm.info mixed mode java.vm.name OpenJDK 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.8 java.vm.vendor Oracle Corporation java.vm.version 25.131-b11 jna.loaded true jna.platform.library.path /usr/lib/x86_64-linux-gnu:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/lib jnidispatch.path /tmp/jna--1712433994/jna109663947143428543.tmp line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true os.arch amd64 os.name Linux os.version 3.16.0-4-amd64 path.separator : sun.arch.data.model 64 sun.boot.class.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/resources.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jsse.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jce.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/charsets.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/jfr.jar:/usr/lib/jvm/java-8-openjdk-amd64/jre/classes sun.boot.library.path /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64 sun.cpu.endian little sun.cpu.isalist sun.font.fontmanager sun.awt.X11FontManager sun.io.unicode.encoding UnicodeLittle sun.java.command /usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --httpKeepAliveTimeout=60000 sun.java.launcher SUN_STANDARD sun.jnu.encoding UTF-8 sun.management.compiler HotSpot 64-Bit Tiered Compilers sun.os.patch.level unknown svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false user.country GB user.dir / user.home /var/lib/jenkins user.language en user.name jenkins user.timezone Europe/London Environment Variables _ /usr/bin/daemon HOME /var/lib/jenkins JENKINS_HOME /mnt/jenkins-home LANG en_GB.UTF-8 LANGUAGE en_GB:en LOGNAME jenkins MAIL /var/mail/jenkins PATH /usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games PWD /var/lib/jenkins SHELL /bin/bash SHLVL 1 TERM xterm-256color USER jenkins Plugins ace-editor 1.1 true ant 1.7 true antisamy-markup-formatter 1.5 true apache-httpcomponents-client-4-api 4.5.3-2.0 true authentication-tokens 1.3 true azure-commons 0.2.4 true azure-credentials 1.3.1 true azure-vm-agents 0.6.0 true bouncycastle-api 2.16.2 true branch-api 2.0.15 true build-alias-setter 0.4 true build-timeout 1.19 true cloud-stats 0.16 true cloudbees-folder 6.2.1 true conditional-buildstep 1.3.6 true copyartifact 1.39 true credentials 2.1.16 true credentials-binding 1.13 true disk-usage 0.28 true display-url-api 2.1.0 true docker-commons 1.9 true docker-workflow 1.14 true durable-task 1.15 true email-ext 2.61 true external-monitor-job 1.7 true ghprb 1.39.1-0-Custom true git 3.6.4 true git-client 2.6.0 true git-server 1.7 true github 1.28.1 true github-api 1.90 true github-branch-source 2.2.6 true github-oauth 0.28.1 true github-organization-folder 1.6 true gradle 1.28 true groovy 2.0 true handlebars 1.1.1 true icon-shim 2.0.3 true jackson2-api 2.8.7.0 true javadoc 1.4 true job-dsl 1.66 true jobConfigHistory 2.18 true jquery 1.12.4-0 true jquery-detached 1.2.1 true jsch 0.1.54.1 true junit 1.21 true ldap 1.17 true lockable-resources 2.0 true mailer 1.20 true mapdb-api 1.0.9.0 true matrix-auth 2.1.1 true matrix-project 1.12 true maven-plugin 3.0 true metrics 3.1.2.10 true momentjs 1.1.1 true msbuild 1.28 true nodelabelparameter 1.7.2 true pam-auth 1.3 true parameterized-trigger 2.35.2 true pipeline-build-step 2.5.1 true pipeline-github-lib 1.0 true pipeline-graph-analysis 1.5 true pipeline-input-step 2.8 true pipeline-milestone-step 1.3.1 true pipeline-model-api 1.2.3 true pipeline-model-declarative-agent 1.1.1 true pipeline-model-definition 1.2.3 true pipeline-model-extensions 1.2.3 true pipeline-rest-api 2.9 true pipeline-stage-step 2.3 true pipeline-stage-tags-metadata 1.2.3 true pipeline-stage-view 2.9 true pipeline-utility-steps 1.5.1 true plain-credentials 1.4 true PrioritySorter 3.5.1 true promoted-builds 2.31 true rebuild 1.27 true resource-disposer 0.8 true run-condition 1.0 true scm-api 2.2.5 true script-security 1.35 true ssh-agent 1.15 true ssh-credentials 1.13 true ssh-slaves 1.22 true structs 1.10 true subversion 2.9 true throttle-concurrents 2.0.1 true timestamper 1.8.8 true token-macro 2.3 true windows-slaves 1.3.1 true workflow-aggregator 2.5 true workflow-api 2.23.1 true workflow-basic-steps 2.6 true workflow-cps 2.41 true workflow-cps-global-lib 2.9 true workflow-durable-task-step 2.17 true workflow-job 2.12.2 true workflow-multibranch 2.16 true workflow-scm-step 2.6 true workflow-step-api 2.13 true workflow-support 2.16 true ws-cleanup 0.34 true
We use a linux-scalable label which spins up agents on Azure. This works mostly well, but have had this issue on a couple of machines:
- Jenkins spins up an agent
Feb 15, 2018 3:26:00 AM com.microsoft.azure.vmagent.AzureVMCloud$4 call INFO: Azure Cloud: provision: Adding agent linux-scalablef495f0 to Jenkins nodes Feb 15, 2018 3:27:35 AM com.microsoft.azure.vmagent.AzureVMAgent createComputer INFO: AzureVMAgent: createComputer: start for agent linux-scalablef495f0 Feb 15, 2018 3:27:35 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher launch INFO: AzureVMAgentSSHLauncher: launch: launch method called for agent linux-scalablef495f0 Feb 15, 2018 3:27:47 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: getting remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:47 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: Got remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:58 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: getting remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22 Feb 15, 2018 3:27:58 AM com.microsoft.azure.vmagent.remote.AzureVMAgentSSHLauncher getRemoteSession INFO: AzureVMAgentSSHLauncher: getRemoteSession: Got remote session for user jenkins to host linux-scalablef495f0.westeurope.cloudapp.azure.com:22
- Starts build
03:28:17 Running on linux-scalablef495f0 in /mnt/resource/jenkins/workspace/Build-Dashboard/opensource
- The Azure plugin suddenly reports that the VM didn't start up.
Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMCloud$4 call SEVERE: Failure creating provisioned agent 'linux-scalablef495f0' com.microsoft.azure.vmagent.exceptions.AzureCloudException: AzureVMCloud: createProvisionedAgent: Deployment jenkins-linux-8-core-build-slave0215032324572 failed, max timeout reached (1200 seconds) at com.microsoft.azure.vmagent.exceptions.AzureCloudException.create(AzureCloudException.java:37) at com.microsoft.azure.vmagent.AzureVMCloud.createProvisionedAgent(AzureVMCloud.java:642) at com.microsoft.azure.vmagent.AzureVMCloud$4.call(AzureVMCloud.java:833) at com.microsoft.azure.vmagent.AzureVMCloud$4.call(AzureVMCloud.java:810) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) Feb 15, 2018 3:44:29 AM hudson.remoting.SynchronousCommandTransport$ReaderThread run
- Plugin checks if vm exists, and finds it, then terminates it.
Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate virtualMachineExists INFO: AzureVMManagementServiceDelegate: virtualMachineExists: check for jenkins-linux-8-core-build-slavef495f0 Feb 15, 2018 3:44:00 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate virtualMachineExists INFO: AzureVMManagementServiceDelegate: virtualMachineExists: jenkins-linux-8-core-build-slavef495f0 exists Feb 15, 2018 3:44:02 AM com.microsoft.rest.interceptors.LoggingInterceptor log Feb 15, 2018 3:44:24 AM com.microsoft.azure.vmagent.AzureVMManagementServiceDelegate terminateVirtualMachine INFO: AzureVMManagementServiceDelegate: terminateVirtualMachine: Removing virtual machine jenkins-linux-8-core-build-slavef495f0
- I/O error in channel jenkins-linux-scalablef495f0 error
SEVERE: I/O error in channel jenkins-linux-scalablef495f0 java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73) Caused by: java.io.EOFException at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638) at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113) at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853) at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349) at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59)
