Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-26174

jenkins slave breaks connection after build steps finishing

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • core, remoting
    • Jenkins ver. 1.580.2, jenkins server ubuntu x64

      I have a matrix-job.
      Jclouds plugin creates slaves for build.
      Slaves connect to jenkins via jnlp.

      Sometimes slave breaks connection:

      14:39:55  2 failed, 214 passed, 1 skipped, 6 deselected, 1 warnings, 1 rerun in 2283.12 seconds 
      14:39:55 + true
      14:39:55 Looks like the node went offline during the build. Check the slave log for the details.
      
      14:39:55 
      
      FATAL: Remote call on win7-x86-ru-name-4a0 failed
      14:39:55 java.io.IOException: Remote call on win7-x86-ru-name-4a0 failed
      14:39:55    at hudson.remoting.Channel.call(Channel.java:760)
      14:39:55    at hudson.Launcher$RemoteLauncher.kill(Launcher.java:941)
      14:39:55    at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:556)
      14:39:55    at hudson.model.Run.execute(Run.java:1745)
      14:39:55    at hudson.matrix.MatrixRun.run(MatrixRun.java:146)
      14:39:55    at hudson.model.ResourceController.execute(ResourceController.java:89)
      14:39:55    at hudson.model.Executor.run(Executor.java:240)
      14:39:55 Caused by: java.lang.Error: Unable to load resource winp.dll
      14:39:55    at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:381)
      14:39:55    at java.lang.ClassLoader.getResource(Unknown Source)
      14:39:55    at org.jvnet.winp.Native.load(Native.java:85)
      14:39:55    at org.jvnet.winp.Native.<clinit>(Native.java:56)
      14:39:55    at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
      14:39:55    at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
      14:39:55    at hudson.util.ProcessTree.get(ProcessTree.java:328)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:121)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:49)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      14:39:55    at hudson.remoting.Engine$1$1.run(Engine.java:63)
      14:39:55    at java.lang.Thread.run(Unknown Source)
      14:39:55    at ......remote call to partners-win7-home-premium-x86-ru-name-4a0(Native Method)
      14:39:55    at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
      14:39:55    at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
      14:39:55    at hudson.remoting.Channel.call(Channel.java:752)
      14:39:55    ... 6 more
      14:39:55 Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Invalid object ID 2 iota=12
      14:39:55    at hudson.remoting.AsyncFutureImpl.get(AsyncFutureImpl.java:75)
      14:39:55    at hudson.remoting.FutureAdapter.get(FutureAdapter.java:55)
      14:39:55    at hudson.remoting.RemoteClassLoader.findResource(RemoteClassLoader.java:373)
      14:39:55    at java.lang.ClassLoader.getResource(Unknown Source)
      14:39:55    at org.jvnet.winp.Native.load(Native.java:85)
      14:39:55    at org.jvnet.winp.Native.<clinit>(Native.java:56)
      14:39:55    at org.jvnet.winp.WinProcess.enableDebugPrivilege(WinProcess.java:212)
      14:39:55    at hudson.util.ProcessTree$Windows.<clinit>(ProcessTree.java:469)
      14:39:55    at hudson.util.ProcessTree.get(ProcessTree.java:328)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:953)
      14:39:55    at hudson.Launcher$RemoteLauncher$KillTask.call(Launcher.java:944)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:121)
      14:39:55    at hudson.remoting.UserRequest.perform(UserRequest.java:49)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
      14:39:55    at hudson.remoting.Engine$1$1.run(Engine.java:63)
      14:39:55    at java.lang.Thread.run(Unknown Source)
      14:39:55 Caused by: java.lang.IllegalStateException: Invalid object ID 2 iota=12
      14:39:55    at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:348)
      14:39:55    at hudson.remoting.ExportTable.get(ExportTable.java:324)
      14:39:55    at hudson.remoting.Channel.getExportedObject(Channel.java:604)
      14:39:55    at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55    at java.lang.Thread.run(Thread.java:744)
      14:39:55    at ......remote call to channel(Native Method)
      14:39:55    at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
      14:39:55    at hudson.remoting.Request.call(Request.java:171)
      14:39:55    at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:176)
      14:39:55    at com.sun.proxy.$Proxy5.writeJarTo(Unknown Source)
      14:39:55    at hudson.remoting.FileSystemJarCache.retrieve(FileSystemJarCache.java:66)
      14:39:55    at hudson.remoting.JarCacheSupport$1.run(JarCacheSupport.java:62)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
      14:39:55    at java.util.concurrent.FutureTask.run(Unknown Source)
      14:39:55    at hudson.remoting.AtmostOneThreadExecutor$Worker.run(AtmostOneThreadExecutor.java:104)
      14:39:55    ... 1 more
      14:39:55 Caused by: java.lang.Exception: Object was recently deallocated
      14:39:55     #2 (ref.0) : [hudson.remoting.JarLoader]
      14:39:55       Created at Fri Dec 19 13:58:57 MSK 2014
      14:39:55        at hudson.remoting.ExportTable$Entry.<init>(ExportTable.java:93)
      14:39:55        at hudson.remoting.ExportTable.export(ExportTable.java:299)
      14:39:55        at hudson.remoting.Channel.internalExport(Channel.java:600)
      14:39:55        at hudson.remoting.Channel.export(Channel.java:591)
      14:39:55        at hudson.remoting.Channel.<init>(Channel.java:472)
      14:39:55        at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:280)
      14:39:55        at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:290)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:36)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelBuilder.build(NioChannelBuilder.java:52)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol$Handler.jnlpConnect(JnlpSlaveAgentProtocol.java:120)
      14:39:55        at jenkins.slaves.DefaultJnlpSlaveReceiver.handle(DefaultJnlpSlaveReceiver.java:63)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol2$Handler2.run(JnlpSlaveAgentProtocol2.java:57)
      14:39:55        at jenkins.slaves.JnlpSlaveAgentProtocol2.handle(JnlpSlaveAgentProtocol2.java:31)
      14:39:55        at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:156)
      14:39:55       Released at Fri Dec 19 13:58:57 MSK 2014
      14:39:55        at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
      14:39:55        at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
      14:39:55        at hudson.remoting.Channel.unexport(Channel.java:612)
      14:39:55        at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
      14:39:55        at hudson.remoting.Channel$2.handle(Channel.java:483)
      14:39:55        at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
      14:39:55        at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
      14:39:55        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55        at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
      14:39:55        at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
      14:39:55        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55        at java.lang.Thread.run(Thread.java:744)
      14:39:55     Caused by: Command hudson.remoting.UnexportCommand@14daad94 created at
      14:39:55        at hudson.remoting.Command.<init>(Command.java:67)
      14:39:55        at hudson.remoting.Command.<init>(Command.java:50)
      14:39:55        at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
      14:39:55        at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
      14:39:55        at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
      14:39:55        at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
      14:39:55        at java.lang.ref.Finalizer.access$100(Unknown Source)
      14:39:55        at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
      14:39:55    at hudson.remoting.ExportTable.diagnoseInvalidId(ExportTable.java:341)
      14:39:55    at hudson.remoting.ExportTable.get(ExportTable.java:324)
      14:39:55    at hudson.remoting.Channel.getExportedObject(Channel.java:604)
      14:39:55    at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:311)
      14:39:55    at hudson.remoting.Request$2.run(Request.java:324)
      14:39:55    at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
      14:39:55    at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      14:39:55    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      14:39:55    at java.lang.Thread.run(Thread.java:744)
      14:39:55 Caused by:   Released at Fri Dec 19 13:58:57 MSK 2014
      14:39:55    at hudson.remoting.ExportTable$Entry.release(ExportTable.java:125)
      14:39:55    at hudson.remoting.ExportTable.unexportByOid(ExportTable.java:376)
      14:39:55    at hudson.remoting.Channel.unexport(Channel.java:612)
      14:39:55    at hudson.remoting.UnexportCommand.execute(UnexportCommand.java:38)
      14:39:55    at hudson.remoting.Channel$2.handle(Channel.java:483)
      14:39:55    at hudson.remoting.AbstractByteArrayCommandTransport$1.handle(AbstractByteArrayCommandTransport.java:61)
      14:39:55    at org.jenkinsci.remoting.nio.NioChannelHub$2.run(NioChannelHub.java:597)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      14:39:55    at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:111)
      14:39:55    at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
      14:39:55    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      14:39:55    ... 4 more
      14:39:55 Caused by: Command hudson.remoting.UnexportCommand@7f96d721 created at
      14:39:55    at hudson.remoting.Command.<init>(Command.java:67)
      14:39:55    at hudson.remoting.Command.<init>(Command.java:50)
      14:39:55    at hudson.remoting.UnexportCommand.<init>(UnexportCommand.java:33)
      14:39:55    at hudson.remoting.RemoteInvocationHandler.finalize(RemoteInvocationHandler.java:234)
      14:39:55    at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)
      14:39:55    at java.lang.ref.Finalizer.runFinalizer(Unknown Source)
      14:39:55    at java.lang.ref.Finalizer.access$100(Unknown Source)
      14:39:55    at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
      

      Stastically, ~10% of win-slaves in matrix-job break connection with this error

            Unassigned Unassigned
            svchipiga Sergey Chipiga
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: