Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-53260

exception seen on jenkins 2.138

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • kubernetes-plugin
    • None
    • jenkins 2.138

      k8s plugin 1.12.1

      We saw some of our existing pod templates start failing in pipeline builds once we upgraded Jenkins to 2.138.  Slave and master logs of note below, as well as the def of the pod template.

       

      Not sure where the adjustment is needed to have this flow work again. Please advise.

       

      slave log:

      OPENSHIFT_JENKINS_JVM_ARCH='', CONTAINER_MEMORY_IN_MB='8796093022207', using /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-3.b13.el7_5.x86_64/jre/bin/java
      Downloading http://172.30.99.113:80//jnlpJars/remoting.jar ... +
      cd +
      exec java -XX:+UseParallelGC -XX:MinHeapFreeRatio=5 -XX:MaxHeapFreeRatio=10 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -cp /home/jenkins/remoting.jar hudson.remoting.jnlp.Main -headless -url http://172.30.99.113:80/ -tunnel 172.30.205.235:50000 53961ae7fc19701d6d81330d0fe2ce689829d1424e883beea3e52e4d464ab46f nodejs-r66rh Picked up JAVA_TOOL_OPTIONS: -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true
      Aug 16, 2018 6:09:21 PM hudson.remoting.jnlp.Main createEngine INFO: Setting up agent: nodejs-r66rh
      Aug 16, 2018 6:09:21 PM hudson.remoting.jnlp.Main$CuiListener <init> INFO: Jenkins agent is running in headless mode.
      Aug 16, 2018 6:09:21 PM hudson.remoting.Engine startEngine INFO: Using Remoting version: 3.25
      Aug 16, 2018 6:09:21 PM hudson.remoting.Engine startEngine WARNING: No Working Directory. Using the legacy JAR Cache location: /home/jenkins/.jenkins/cache/jars
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Locating server among http://172.30.99.113:80/
      Aug 16, 2018 6:09:22 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
      Aug 16, 2018 6:09:22 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting TCP connection tunneling is enabled. Skipping the TCP Agent Listener Port availability check
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Agent discovery successful Agent address: 172.30.205.235 Agent port: 50000 Identity: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Trying protocol: JNLP4-connect
      Aug 16, 2018 6:09:22 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Remote identity confirmed: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
      Aug 16, 2018 6:09:23 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connected
      Aug 16, 2018 6:09:33 PM org.jenkinsci.remoting.util.AnonymousClassWarnings warn WARNING: Attempt to (de-)serialize anonymous class hudson.FilePath$2; see: https://jenkins.io/redirect/serialization-of-anonymous-classes/
      Aug 16, 2018 6:09:34 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Terminated
      Aug 16, 2018 6:09:34 PM hudson.remoting.Request$2 run INFO: Failed to send back a reply to the request hudson.remoting.Request$2@590fe63d: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@7c2c0bb3:JNLP4-connect connection to jenkins-jnlp.myproject.svc.cluster.local/172.30.205.235:50000": channel is already closed
      Aug 16, 2018 6:09:44 PM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$FindEffectiveRestarters$1 onReconnect INFO: Restarting agent via jenkins.slaves.restarter.UnixSlaveRestarter@74428986 Picked up JAVA_TOOL_OPTIONS: -XX:+UnlockExperimentalVMOptions -XX:+UseCGroupMemoryLimitForHeap -Dsun.zip.disableMemoryMapping=true
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main createEngine INFO: Setting up agent: nodejs-r66rh
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener <init> INFO: Jenkins agent is running in headless mode.
      Aug 16, 2018 6:09:45 PM hudson.remoting.Engine startEngine INFO: Using Remoting version: 3.25
      Aug 16, 2018 6:09:45 PM hudson.remoting.Engine startEngine WARNING: No Working Directory. Using the legacy JAR Cache location: /home/jenkins/.jenkins/cache/jars
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Locating server among http://172.30.99.113:80/
      Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
      Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve INFO: Remoting TCP connection tunneling is enabled. Skipping the TCP Agent Listener Port availability check
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Agent discovery successful Agent address: 172.30.205.235 Agent port: 50000 Identity: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Handshaking
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Trying protocol: JNLP4-connect
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Remote identity confirmed: be:cd:d7:f5:f5:e5:19:2f:5a:b0:bf:43:e2:a9:0b:75
      Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer onRecv INFO: [JNLP4-connect connection to jenkins-jnlp.myproject.svc.cluster.local/172.30.205.235:50000] Local headers refused by remote: Unknown client name: nodejs-r66rh
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Protocol JNLP4-connect encountered an unexpected exception java.util.concurrent.ExecutionException: org.jenkinsci.remoting.protocol.impl.ConnectionRefusalException: Unknown client name: nodejs-r66rh
      at org.jenkinsci.remoting.util.SettableFuture.get(SettableFuture.java:223)
      at hudson.remoting.Engine.innerRun(Engine.java:614)
      at hudson.remoting.Engine.run(Engine.java:474)
      Caused by: org.jenkinsci.remoting.protocol.impl.ConnectionRefusalException: Unknown client name: nodejs-r66rh
      at org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer.newAbortCause(ConnectionHeadersFilterLayer.java:378)
      at org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer.onRecvClosed(ConnectionHeadersFilterLayer.java:433)
      at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
      at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:172)
      at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
      at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154)
      at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer.access$1500(BIONetworkLayer.java:48)
      at org.jenkinsci.remoting.protocol.impl.BIONetworkLayer$Reader.run(BIONetworkLayer.java:247)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
      at java.lang.Thread.run(Thread.java:748) Suppressed: java.nio.channels.ClosedChannelException ... 7 more
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Connecting to 172.30.205.235:50000
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP4-plaintext not supported, skipping
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP3-connect not supported, skipping
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP2-connect not supported, skipping
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener status INFO: Server reports protocol JNLP-connect not supported, skipping
      Aug 16, 2018 6:09:45 PM hudson.remoting.jnlp.Main$CuiListener error SEVERE: The server rejected the connection: None of the protocols were accepted java.lang.Exception: The server rejected the connection: None of the protocols were accepted
      at hudson.remoting.Engine.onConnectionRejected(Engine.java:675)
      at hudson.remoting.Engine.innerRun(Engine.java:639)
      at hudson.remoting.Engine.run(Engine.java:474)

      master log:

      Aug 16, 2018 6:09:34 PM org.jenkinsci.plugins.workflow.job.WorkflowRun finish INFO: asdf #7 completed: SUCCESS
      Aug 16, 2018 6:09:34 PM jenkins.slaves.DefaultJnlpSlaveReceiver channelClosed WARNING: Computer.threadPoolForRemoting 23 for nodejs-r66rh terminated java.nio.channels.ClosedChannelException
      at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209)
      at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222)
      at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:832)
      at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200)
      at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213)
      at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:800)
      at org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:173)
      at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314)
      at hudson.remoting.Channel.close(Channel.java:1450)
      at hudson.remoting.Channel.close(Channel.java:1403)
      at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:821)
      at hudson.slaves.SlaveComputer.access$800(SlaveComputer.java:105)
      at hudson.slaves.SlaveComputer$3.run(SlaveComputer.java:737)
      at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
      at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Aug 16, 2018 6:09:45 PM hudson.TcpSlaveAgentListener$ConnectionHandler run INFO: Accepted JNLP4-connect connection #2 from /172.17.0.6:59884
      Aug 16, 2018 6:09:45 PM org.jenkinsci.remoting.protocol.impl.ConnectionHeadersFilterLayer onRecv INFO: [JNLP4-connect connection from 172.17.0.6/172.17.0.6:59884] Refusing headers from remote: Unknown client name: nodejs-r66rh
      Aug 16, 2018 6:09:46 PM hudson.TcpSlaveAgentListener$ConnectionHandler run WARNING: Connection #3 failed java.io.EOFException
      at java.io.DataInputStream.readFully(DataInputStream.java:197)
      at java.io.DataInputStream.readFully(DataInputStream.java:169)
      at hudson.TcpSlaveAgentListener$ConnectionHandler.run(TcpSlaveAgentListener.java:242)
      Aug 16, 2018 6:11:31 PM io.fabric8.jenkins.openshiftsync.BuildWatcher reconcileRunsAndBuilds INFO: Reconciling job runs and builds
      Aug 16, 2018 6:16:31 PM io.fabric8.jenkins.openshiftsync.BuildWatcher reconcileRunsAndBuilds INFO: Reconciling job runs and builds
      Aug 16, 2018 6:16:31 PM okhttp3.internal.platform.Platform log INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?
      Aug 16, 2018 6:16:31 PM okhttp3.internal.platform.Platform log INFO: ALPN callback dropped: HTTP/2 is disabled. Is alpn-boot on the boot class path?

       

      Pod template:

       

      <org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud>
      <name>openshift</name>
      <templates>
      <org.csanchez.jenkins.plugins.kubernetes.PodTemplate>
      <inheritFrom></inheritFrom>
      <name>nodejs</name>
      <instanceCap>2147483647</instanceCap>
      <idleMinutes>0</idleMinutes>
      <label>nodejs</label>
      <serviceAccount>${oc_serviceaccount_name}</serviceAccount>
      <nodeSelector></nodeSelector>
      <volumes/>
      <containers>
      <org.csanchez.jenkins.plugins.kubernetes.ContainerTemplate>
      <name>jnlp</name>
      <image>${NODEJS_SLAVE}</image>
      <privileged>false</privileged>
      <alwaysPullImage>true</alwaysPullImage>
      <workingDir>/tmp</workingDir>
      <command></command>
      <args>\${computer.jnlpmac} \${computer.name}</args>
      <ttyEnabled>false</ttyEnabled>
      <resourceRequestCpu></resourceRequestCpu>
      <resourceRequestMemory></resourceRequestMemory>
      <resourceLimitCpu></resourceLimitCpu>
      <resourceLimitMemory></resourceLimitMemory>
      <envVars/>
      </org.csanchez.jenkins.plugins.kubernetes.ContainerTemplate>
      </containers>
      <envVars/>
      <annotations/>
      <imagePullSecrets/>
      <nodeProperties/>
      </org.csanchez.jenkins.plugins.kubernetes.PodTemplate>
      </templates>
      <serverUrl>https://${KUBERNETES_SERVICE_HOST}:${KUBERNETES_SERVICE_PORT}</serverUrl>
      <skipTlsVerify>false</skipTlsVerify>
      <addMasterProxyEnvVars>true</addMasterProxyEnvVars>
      <serverCertificate>${crt_contents}</serverCertificate>
      <namespace>${PROJECT_NAME}</namespace>
      <jenkinsUrl>http://${JENKINS_SERVICE_HOST}:${JENKINS_SERVICE_PORT}</jenkinsUrl>
      <jenkinsTunnel>${JNLP_HOST}:${JNLP_PORT}</jenkinsTunnel>
      <credentialsId>1a12dfa4-7fc5-47a7-aa17-cc56572a41c7</credentialsId>
      <containerCap>100</containerCap>
      <retentionTimeout>5</retentionTimeout>
      </org.csanchez.jenkins.plugins.kubernetes.KubernetesCloud>

       

       

            gmontero Gabe Montero
            gmontero Gabe Montero
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: