Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-61676

1.44 -> 1.49.1 Can't connect agent and doesn't terminate instance

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • ec2-plugin
    • None

      I recently updated my plugin from 1.44 to 1.49.1 and instances spin up, don't connect, and then don't terminate. If I wasn't looking at aws this would've cost me a lot of money (had over 100 instances running doing nothing).

       

      Everything was working for months before updating. I have an agent.jar that sits in /home/ubuntu. The log from one of the instances is below. If I had to guess I'd say that the issue is that the host is null. Also I don't know what /tmp/remoting.jar is.

       

      Testing the connection and Checking the AMI both succeed.

       

      I have a subnet ID for VPC set correctly.

       

      Root command prefix = 

      Slave command prefix = nice -15

      Slave command suffix =

      Remote ssh port = 22

       

      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Launching instance: <instance id>
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: bootstrap()
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Getting keypair...
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Using private key android (SHA-1 fingerprint <fingerprint>)
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Authenticating as ubuntu
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Connecting to null on port 22, with timeout 35000.
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Connected via SSH.
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: connect fresh as root
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Connecting to null on port 22, with timeout 35000.
      Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
      INFO: Connected via SSH.
      Mar 25, 2020 1:15:18 AM hudson.plugins.ec2.EC2Cloud
      INFO: Creating tmp directory (/tmp) if it does not exist
      Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
      INFO: Verifying: java -fullversion
      openjdk full version "1.8.0_242-8u242-b08-0ubuntu3~18.04-b08"
      Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
      INFO: Verifying: which scp
      /usr/bin/scp
      Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
      INFO: Copying remoting.jar to: /tmp
      Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
      INFO: Launching remoting agent (via SSH client process): ssh -o StrictHostKeyChecking=no -i /tmp/ec2_5958435854098369335.pem ubuntu@null -p 22 nice -15  java -server -XX:+AlwaysPreTouch -XX:+UseG1GC -XX:+ExplicitGCInvokesConcurrent -XX:+ParallelRefProcEnabled -XX:+UseStringDeduplication -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=20 -XX:+UnlockDiagnosticVMOptions -XX:G1SummarizeRSetStatsPeriod=1 -Xmx6g -Xms6g -jar /tmp/remoting.jar -workDir /home/ubuntu
      [03/25/20 01:15:19] Launching agent
      $ ssh -o StrictHostKeyChecking=no -i /tmp/ec2_5958435854098369335.pem ubuntu@null -p 22 nice -15  java -server -XX:+AlwaysPreTouch -XX:+UseG1GC -XX:+ExplicitGCInvokesConcurrent -XX:+ParallelRefProcEnabled -XX:+UseStringDeduplication -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=20 -XX:+UnlockDiagnosticVMOptions -XX:G1SummarizeRSetStatsPeriod=1 -Xmx6g -Xms6g -jar /tmp/remoting.jar -workDir /home/ubuntu
      ssh: Could not resolve hostname null: Temporary failure in name resolution
      ERROR: Unable to launch the agent for EC2 (aws-android) - android-slave (<instance id>)
      java.io.EOFException: unexpected stream termination
      	at hudson.remoting.ChannelBuilder.negotiate(ChannelBuilder.java:415)
      	at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:360)
      	at hudson.slaves.SlaveComputer.setChannel(SlaveComputer.java:419)
      	at hudson.slaves.CommandLauncher.launch(CommandLauncher.java:165)
      	at hudson.plugins.ec2.ssh.EC2UnixLauncher.launchScript(EC2UnixLauncher.java:247)
      	at hudson.plugins.ec2.EC2ComputerLauncher.launch(EC2ComputerLauncher.java:48)
      	at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:292)
      	at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      	at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      

            thoulen FABRIZIO MANFREDI
            eygraber Eli Graber
            Votes:
            2 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: