Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-25322

EnvInject channel is already closed when used with ec2 autoscaling plugin

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Critical Critical
    • ec2-plugin
    • None

      We have a job that's constantly failing when using ec2 plugin + envinject + android emulator. The problem is ec2 had already scaled down the slave in the "stopped" state, and when a job is launching, it tries to run EnvInject into that slave (which is now offlined) and obviously it fails. Is there a workaround for this? Or can we fix it?

      Running Jenkins LTS ver. 1.565.2

      • ec2 : 1.24
      • envinject : 1.90
      • android-emulator: 2.11.1
      Retriggered by user bot for Gerrit: https://mygerrit.local.local/41954
      [EnvInject] - Loading node environment variables.
      ERROR: SEVERE ERROR occurs
      org.jenkinsci.lib.envinject.EnvInjectException: hudson.remoting.ChannelClosedException: channel is already closed
      	at org.jenkinsci.plugins.envinject.service.EnvironmentVariablesNodeLoader.gatherEnvironmentVariablesNode(EnvironmentVariablesNodeLoader.java:75)
      	at org.jenkinsci.plugins.envinject.EnvInjectListener.loadEnvironmentVariablesNode(EnvInjectListener.java:81)
      	at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:39)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:581)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:487)
      	at hudson.model.Run.execute(Run.java:1706)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      Caused by: hudson.remoting.ChannelClosedException: channel is already closed
      	at hudson.remoting.Channel.send(Channel.java:541)
      	at hudson.remoting.Request.call(Request.java:129)
      	at hudson.remoting.Channel.call(Channel.java:739)
      	at hudson.FilePath.act(FilePath.java:1009)
      	at org.jenkinsci.plugins.envinject.service.EnvironmentVariablesNodeLoader.gatherEnvironmentVariablesNode(EnvironmentVariablesNodeLoader.java:44)
      	... 8 more
      Caused by: java.io.IOException
      	at hudson.remoting.Channel.close(Channel.java:1027)
      	at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110)
      	at hudson.remoting.PingThread.ping(PingThread.java:120)
      	at hudson.remoting.PingThread.run(PingThread.java:81)
      Caused by: java.util.concurrent.TimeoutException: Ping started on 1414104936664 hasn't completed at 1414105176664
      	... 2 more
      [android-lint] Collecting Android Lint files...
      ERROR: Publisher org.jenkinsci.plugins.android_lint.LintPublisher aborted due to exception
      java.lang.NullPointerException
      	at org.jenkinsci.plugins.android_lint.LintPublisher.perform(LintPublisher.java:111)
      	at hudson.plugins.analysis.core.HealthAwarePublisher.perform(HealthAwarePublisher.java:144)
      	at hudson.plugins.analysis.core.HealthAwareRecorder.perform(HealthAwareRecorder.java:333)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      [CHECKSTYLE] Collecting checkstyle analysis files...
      ERROR: Publisher hudson.plugins.checkstyle.CheckStylePublisher aborted due to exception
      java.lang.NullPointerException
      	at hudson.plugins.checkstyle.CheckStylePublisher.perform(CheckStylePublisher.java:143)
      	at hudson.plugins.analysis.core.HealthAwarePublisher.perform(HealthAwarePublisher.java:144)
      	at hudson.plugins.analysis.core.HealthAwareRecorder.perform(HealthAwareRecorder.java:333)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      [FINDBUGS] Collecting findbugs analysis files...
      ERROR: Publisher hudson.plugins.findbugs.FindBugsPublisher aborted due to exception
      java.lang.NullPointerException
      	at hudson.plugins.findbugs.FindBugsPublisher.perform(FindBugsPublisher.java:193)
      	at hudson.plugins.analysis.core.HealthAwarePublisher.perform(HealthAwarePublisher.java:144)
      	at hudson.plugins.analysis.core.HealthAwareRecorder.perform(HealthAwareRecorder.java:333)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      [PMD] Collecting PMD analysis files...
      ERROR: Publisher hudson.plugins.pmd.PmdPublisher aborted due to exception
      java.lang.NullPointerException
      	at hudson.plugins.pmd.PmdPublisher.perform(PmdPublisher.java:139)
      	at hudson.plugins.analysis.core.HealthAwarePublisher.perform(HealthAwarePublisher.java:144)
      	at hudson.plugins.analysis.core.HealthAwareRecorder.perform(HealthAwareRecorder.java:333)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      Recording test results
      ERROR: Publisher hudson.tasks.junit.JUnitResultArchiver aborted due to exception
      hudson.remoting.ChannelClosedException: channel is already closed
      	at hudson.remoting.Channel.send(Channel.java:541)
      	at hudson.remoting.Request.call(Request.java:129)
      	at hudson.remoting.Channel.call(Channel.java:739)
      	at hudson.EnvVars.getRemote(EnvVars.java:404)
      	at hudson.model.Computer.getEnvironment(Computer.java:912)
      	at jenkins.model.CoreEnvironmentContributor.buildEnvironmentFor(CoreEnvironmentContributor.java:29)
      	at hudson.model.Run.getEnvironment(Run.java:2221)
      	at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:885)
      	at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:126)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      Caused by: java.io.IOException
      	at hudson.remoting.Channel.close(Channel.java:1027)
      	at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110)
      	at hudson.remoting.PingThread.ping(PingThread.java:120)
      	at hudson.remoting.PingThread.run(PingThread.java:81)
      Caused by: java.util.concurrent.TimeoutException: Ping started on 1414104936664 hasn't completed at 1414105176664
      	... 2 more
      Archiving artifacts
      Recording fingerprints
      ERROR: Failed to record fingerprints
      hudson.remoting.ChannelClosedException: channel is already closed
      	at hudson.remoting.Channel.send(Channel.java:541)
      	at hudson.remoting.Request.call(Request.java:129)
      	at hudson.remoting.Channel.call(Channel.java:739)
      	at hudson.EnvVars.getRemote(EnvVars.java:404)
      	at hudson.model.Computer.getEnvironment(Computer.java:912)
      	at jenkins.model.CoreEnvironmentContributor.buildEnvironmentFor(CoreEnvironmentContributor.java:29)
      	at hudson.model.Run.getEnvironment(Run.java:2221)
      	at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:885)
      	at hudson.tasks.Fingerprinter.perform(Fingerprinter.java:116)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      Caused by: java.io.IOException
      	at hudson.remoting.Channel.close(Channel.java:1027)
      	at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110)
      	at hudson.remoting.PingThread.ping(PingThread.java:120)
      	at hudson.remoting.PingThread.run(PingThread.java:81)
      Caused by: java.util.concurrent.TimeoutException: Ping started on 1414104936664 hasn't completed at 1414105176664
      	... 2 more
      ERROR: [description-setter] Error while parsing logs for description-setter
      hudson.remoting.ChannelClosedException: channel is already closed
      	at hudson.remoting.Channel.send(Channel.java:541)
      	at hudson.remoting.Request.call(Request.java:129)
      	at hudson.remoting.Channel.call(Channel.java:739)
      	at hudson.EnvVars.getRemote(EnvVars.java:404)
      	at hudson.model.Computer.getEnvironment(Computer.java:912)
      	at jenkins.model.CoreEnvironmentContributor.buildEnvironmentFor(CoreEnvironmentContributor.java:29)
      	at hudson.model.Run.getEnvironment(Run.java:2221)
      	at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:885)
      	at hudson.plugins.descriptionsetter.DescriptionSetterHelper.setDescription(DescriptionSetterHelper.java:47)
      	at hudson.plugins.descriptionsetter.DescriptionSetterPublisher.perform(DescriptionSetterPublisher.java:70)
      	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:756)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
      	at hudson.model.Build$BuildExecution.post2(Build.java:182)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:669)
      	at hudson.model.Run.execute(Run.java:1731)
      	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      	at hudson.model.ResourceController.execute(ResourceController.java:88)
      	at hudson.model.Executor.run(Executor.java:232)
      Caused by: java.io.IOException
      	at hudson.remoting.Channel.close(Channel.java:1027)
      	at hudson.slaves.ChannelPinger$1.onDead(ChannelPinger.java:110)
      	at hudson.remoting.PingThread.ping(PingThread.java:120)
      	at hudson.remoting.PingThread.run(PingThread.java:81)
      Caused by: java.util.concurrent.TimeoutException: Ping started on 1414104936664 hasn't completed at 1414105176664
      	... 2 more
      [BFA] Scanning build for known causes...
      
      [BFA] Done. 0s
      Notifying upstream projects of job completion
      Loading slave statistic
      Slave statistic loaded
      [EnvInject] - [ERROR] - SEVERE ERROR occurs: channel is already closed
      Finished: FAILURE
      

            francisu Francis Upton
            samxiao Sam Xiao
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: