Loading...

Type: Bug
Resolution: Cannot Reproduce
Priority: Major
Component/s: core
Labels:
None
Environment:
3.2.0-4-amd64 #1 SMP Debian 3.2.46-1 x86_64 GNU/Linux
Jenkins ver. 1.558

Similar Issues:

Show

We have a job that is hung and cannot be killed in the Jenkins UI. The job has been in this state for the last 11 days, and persists even after killing the agent process on the slave. Previous to this, the job had been running reliably every 15 minutes for nearly two months. The job itself simply checks out some code from git, measures ping time to a server somewhere, and appends the result to CSV file, which it then publishes as an artifact.

The console output from the hanging job is as follows:

Started by timer
[EnvInject] - Loading node environment variables.

The stack trace for the hanging thread is:

Executor #9 for minibrokins : executing Jira Latency Checker #4531" Id=144 Group=main WAITING on 

java.lang.Object@5ab70f14
  at java.lang.Object.wait(Native Method)
  -  waiting on java.lang.Object@5ab70f14
  at java.lang.Object.wait(Object.java:503)
  at org.netbeans.lib.profiler.global.TransactionalSupport.beginTrans(TransactionalSupport.java:69)
  at org.netbeans.lib.profiler.global.TransactionalSupport.beginTrans(TransactionalSupport.java:38)
  at org.netbeans.lib.profiler.server.ProfilerInterface.classLoadHook(ProfilerInterface.java:839)
  at java.lang.Class.getDeclaredConstructors0(Native Method)
  at java.lang.Class.privateGetDeclaredConstructors(Class.java:2483)
  at java.lang.Class.getConstructor0(Class.java:2793)
  at java.lang.Class.newInstance(Class.java:345)
  at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:399)
  at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:396)
  at java.security.AccessController.doPrivileged(Native Method)
  at sun.reflect.MethodAccessorGenerator.generate(MethodAccessorGenerator.java:395)
  at sun.reflect.MethodAccessorGenerator.generateConstructor(MethodAccessorGenerator.java:94)
  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:48)
  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
  at java.lang.reflect.Proxy.newInstance(Proxy.java:748)
  at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:739)
  at hudson.remoting.RemoteInvocationHandler.wrap(RemoteInvocationHandler.java:99)
  at hudson.remoting.Channel.export(Channel.java:567)
  at hudson.remoting.RemoteClassLoader.export(RemoteClassLoader.java:659)
  at hudson.remoting.UserRequest.<init>(UserRequest.java:69)
  at hudson.remoting.Channel.call(Channel.java:721)
  at hudson.FilePath.act(FilePath.java:1003)
  at org.jenkinsci.plugins.envinject.service.EnvironmentVariablesNodeLoader.gatherEnvironmentVariablesNode

(EnvironmentVariablesNodeLoader.java:44)
  at org.jenkinsci.plugins.envinject.EnvInjectListener.loadEnvironmentVariablesNode(EnvInjectListener.java:81)
  at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:39)
  at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:575)
  at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:481)
  at hudson.model.Run.execute(Run.java:1689)
  at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
  at hudson.model.ResourceController.execute(ResourceController.java:88)

System Info is as follows:

System Properties



Name  ↓

Value   



awt.toolkit

sun.awt.X11.XToolkit



btrace.port

48938



executable-war

/usr/share/jenkins/jenkins.war



file.encoding

UTF-8



file.encoding.pkg

sun.io



file.separator

/



hudson.diyChunking

true



java.awt.graphicsenv

sun.awt.X11GraphicsEnvironment



java.awt.headless

true



java.awt.printerjob

sun.print.PSPrinterJob



java.class.path

/usr/share/jenkins/jenkins.war



java.class.version

51.0



java.endorsed.dirs

/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/endorsed



java.ext.dirs

/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/ext:/usr/java/packages/lib/ext



java.home

/usr/lib/jvm/j2sdk1.7-oracle/jre



java.io.tmpdir

/tmp



java.library.path

/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib



java.rmi.server.randomIDs

true



java.runtime.name

Java(TM) SE Runtime Environment



java.runtime.version

1.7.0_25-b15



java.specification.name

Java Platform API Specification



java.specification.vendor

Oracle Corporation



java.specification.version

1.7



java.vendor

Oracle Corporation



java.vendor.url

http://java.oracle.com/



java.vendor.url.bug

http://bugreport.sun.com/bugreport/



java.version

1.7.0_25



java.vm.info

mixed mode



java.vm.name

Java HotSpot(TM) 64-Bit Server VM



java.vm.specification.name

Java Virtual Machine Specification



java.vm.specification.vendor

Oracle Corporation



java.vm.specification.version

1.7



java.vm.vendor

Oracle Corporation



java.vm.version

23.25-b01



javamelody.About Monitoring

https://wiki.jenkins-ci.org/display/JENKINS/Monitoring



javamelody.analytics-id

UA-1335263-7



javamelody.custom-reports

Jenkins Info,About Monitoring



javamelody.gzip-compression-disabled

true



javamelody.http-transform-pattern

/\d+/|/site/.+|avadoc/.+|/ws/.+|obertura/.+|estReport/.+|iolations/file/.+|/user/.+|/static/\w+/|/adjuncts/\w+/|/bound/[\w\-]+



javamelody.Jenkins Info

/systemInfo



javamelody.no-database

true



javamelody.storage-directory

//var/lib/jenkins/monitoring



javamelody.system-actions-enabled

true



jna.platform.library.path

/usr/lib/x86_64-linux-gnu:/lib/x86_64-linux-gnu:/lib64:/usr/lib:/lib



line.separator






mail.smtp.sendpartial

true



mail.smtps.sendpartial

true



org.jenkinsci.plugins.gitclient.Git.timeOut

120



os.arch

amd64



os.name

Linux



os.version

3.2.0-4-amd64



path.separator

:



pid

17489



sun.arch.data.model

64



sun.boot.class.path

/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/resources.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/rt.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/sunrsasign.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/jsse.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/jce.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/charsets.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/jfr.jar:/usr/lib/jvm/j2sdk1.7-oracle/jre/classes



sun.boot.library.path

/usr/lib/jvm/j2sdk1.7-oracle/jre/lib/amd64



sun.cpu.endian

little



sun.cpu.isalist




sun.font.fontmanager

sun.awt.X11FontManager



sun.io.unicode.encoding

UnicodeLittle



sun.java.command

/usr/share/jenkins/jenkins.war --webroot=/var/cache/jenkins/war --httpPort=8080 --ajp13Port=-1



sun.java.launcher

SUN_STANDARD



sun.jnu.encoding

UTF-8



sun.management.compiler

HotSpot 64-Bit Tiered Compilers



sun.os.patch.level

unknown



svnkit.http.methods

Digest,Basic,NTLM,Negotiate



svnkit.ssh2.persistent

false



user.country

GB



user.dir

/



user.home

/var/lib/jenkins



user.language

en



user.name

jenkins



user.timezone

Europe/London


Environment Variables



Name  ↓

Value   



_

/usr/bin/daemon



HOME

/var/lib/jenkins



JENKINS_HOME

/var/lib/jenkins



LANG

en_GB.UTF-8



LANGUAGE

en_GB:en



LOGNAME

jenkins



MAIL

/var/mail/jenkins



NLSPATH

/usr/dt/lib/nls/msg/%L/%N.cat



PATH

/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games



PWD

/var/lib/jenkins



SHELL

/bin/bash



SHLVL

1



TERM

xterm



USER

jenkins



XFILESEARCHPATH

/usr/dt/app-defaults/%L/Dt


Plugins



Name  ↓

Version   

Enabled   

Pinned   



active-directory

1.36

true

false



ant

1.2

true

false



antisamy-markup-formatter

1.0

true

false



build-name-setter

1.3

true

false



build-timeout

1.13

true

false



buildtriggerbadge

1.1

true

false



conditional-buildstep

1.3.3

true

false



config-file-provider

2.7.4

true

false



copyartifact

1.30

true

false



credentials

1.10

true

true



cvs

2.11

true

true



disk-usage

0.23

true

false



display-upstream-changes

0.1

true

false



downstream-buildview

1.9

true

false



emma

1.29

true

false



envinject

1.89

true

false



Exclusion

0.10

true

false



external-monitor-job

1.2

true

true



ghprb

1.9

true

false



git

2.2.0

true

false



git-client

1.8.0

true

false



github

1.8

true

false



github-api

1.44

true

false



greenballs

1.14

true

false



groovy

1.15

true

false



groovy-postbuild

1.8

true

false



htmlpublisher

1.3

true

false



instant-messaging

1.28

true

false



ircbot

2.25

true

false



javadoc

1.1

true

false



jenkins-multijob-plugin

1.13

true

false



job-dsl

1.22

true

false



job-import-plugin

1.2

true

false



jobConfigHistory

2.5

true

false



jquery

1.7.2-1

true

false



kpp-management-plugin

1.0.0

true

false



ldap

1.8

true

true



log-parser

1.0.8

true

false



mailer

1.8

true

true



managed-scripts

1.1.1

true

false



matrix-auth

1.1

true

true



matrixtieparent

1.2

true

false



maven-plugin

2.2

true

true



monitoring

1.50.0

true

false



multiple-scms

0.3

true

false



naginator

1.10

true

false



nodelabelparameter

1.5.1

true

false



notification

1.5

true

false



pam-auth

1.1

true

true



parameterized-trigger

2.24

true

false



plot

1.7

true

false



postbuild-task

1.8

true

false



rebuild

1.21

true

false



run-condition

1.0

true

false



scm-api

0.2

true

false



scripttrigger

0.31

true

false



simple-theme-plugin

0.3

true

false



ssh-agent

1.4.1

true

false



ssh-credentials

1.6.1

true

true



ssh-slaves

1.6

true

true



subversion

2.2

true

true



throttle-concurrents

1.8.2

true

false



timestamper

1.5.9

true

false



token-macro

1.10

true

false



translation

1.11

true

true



windows-slaves

1.0

true

false



xcode-plugin

1.4.2

true

false



xunit

1.84

true

false

Notes:
I have yet to try restarting the server, since many other people rely on the server, although from some similar sounding issues (~~JENKINS-17667~~ perhaps?) a restart might be necessary to workaround the issue.

Details

Description

Attachments

Activity

People

Dates