Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-56967

Jenkins Pipeline parallel checkout fails on ECS slave

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Not A Defect
    • Icon: Minor Minor
    • git-plugin, pipeline
    • None
    • Jenkins 2.150.1
      ECS plugin 1.17
      Slave docker image using ubuntu 16.4 and git 2.11.0

      I'm using parallel stage in pipeline, but it not work with ecs container slave, there is no problem if build in native slave.

      Here is my pipeline script

       

       def buildModules = ""; def buildModules = "";
 try { 
    stage('Prepare') { 
       buildModules =          "individualch,desk_individual,desk_individual_customer1,mobile_individual,mobile_individual_customer1,entitych,desk_entity"; mvnHome = "/usr/share/maven" 
} 
    stage('Checkout') {
       parallel desk_built_t: {
            checkout([$class: 'GitSCM', branches: [[name: '*/master']], doGenerateSubmoduleConfigurations: false, extensions: [[$class: 'CheckoutOption', timeout: 120],[$class: 'CloneOption', timeout: 120]], submoduleCfg: [], userRemoteConfigs: [[credentialsId: '4f45191d-63c0-473b-8b5c-6f5621ed148a', url: 'git@bitbucket.org:tiendung/desk_built_t.git']]]) 
 },
      portal_customization: { 
        checkout([$class: 'GitSCM', branches: [[name: "*/${params.portal_customization_branch}"]], doGenerateSubmoduleConfigurations: false, extensions: [[$class: 'CheckoutOption', timeout: 120],[$class: 'CloneOption', timeout: 120],[$class: 'RelativeTargetDirectory', relativeTargetDir: 'portal_customization']], submoduleCfg: [], userRemoteConfigs: [[credentialsId: '4f45191d-63c0-473b-8b5c-6f5621ed148a', url: 'git@bitbucket.org:tiendung/portalcustomization.git']]]) }
...

       Here is error in ECS slave

       

      [Pipeline] node
Still waiting to schedule task
Waiting for next available executor on ‘ecsaws-cdbb5d93a7bb2’
Running on ecsaws-cdc542bcff17e in /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel
[Pipeline] {
[Pipeline] stage
[Pipeline] { (Prepare)
[Pipeline] }
[Pipeline] // stage
[Pipeline] stage
[Pipeline] { (Checkout)
[Pipeline] parallel
[Pipeline] [desk_built_t] { (Branch: desk_built_t)
[Pipeline] [portal_customization] { (Branch: portal_customization)
[Pipeline] [standard] { (Branch: standard)
[Pipeline] [basic_component] { (Branch: basic_component)
[Pipeline] [individualch] { (Branch: individualch)
[Pipeline] [desk_individual] { (Branch: desk_individual)
[Pipeline] [desk_individual_customer1] { (Branch: desk_individual_customer1)
[Pipeline] [mobile_individual] { (Branch: mobile_individual)
[Pipeline] [mobile_individual_customer1] { (Branch: mobile_individual_customer1)
[Pipeline] [entitych] { (Branch: entitych)
[Pipeline] [desk_entity] { (Branch: desk_entity)
[Pipeline] [desk_built_t] checkout
[Pipeline] [portal_customization] checkout
[Pipeline] [standard] checkout
[Pipeline] [basic_component] checkout
[Pipeline] [individualch] checkout
[Pipeline] [desk_individual] checkout
[Pipeline] [desk_individual_customer1] checkout
[Pipeline] [mobile_individual] checkout
[Pipeline] [mobile_individual_customer1] checkout
[Pipeline] [entitych] checkout
[Pipeline] [desk_entity] checkout
[desk_built_t] Cloning the remote Git repository
[desk_built_t] Cloning repository git@bitbucket.org:tiendung/desk_built_t.git
[desk_built_t]  > git init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel # timeout=10
[desk_built_t] Fetching upstream changes from git@bitbucket.org:tiendung/desk_built_t.git
[desk_built_t]  > git --version # timeout=10
[portal_customization] Cloning the remote Git repository
[portal_customization] Cloning repository git@bitbucket.org:tiendung/portalcustomization.git
[portal_customization]  > git init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/portal_customization # timeout=10
[portal_customization] ERROR: Error cloning remote repo 'origin'
[portal_customization] hudson.plugins.git.GitException: Could not init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/portal_customization
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$5.execute(CliGitAPIImpl.java:787)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:579)
[portal_customization]       at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
[portal_customization]       at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
[portal_customization]       at hudson.remoting.UserRequest.perform(UserRequest.java:153)
[portal_customization]       at hudson.remoting.UserRequest.perform(UserRequest.java:50)
[portal_customization]       at hudson.remoting.Request$2.run(Request.java:336)
[portal_customization]       at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
[portal_customization]       at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[portal_customization]       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[portal_customization]       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[portal_customization]       at hudson.remoting.Engine$1$1.run(Engine.java:94)
[portal_customization]       at java.lang.Thread.run(Thread.java:748)
[portal_customization]       Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from 10.124.2.148/10.124.2.148:41106
[portal_customization]              at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
[portal_customization]              at hudson.remoting.UserResponse.retrieve(UserRequest.java:389)
[portal_customization]              at hudson.remoting.Channel.call(Channel.java:955)
[portal_customization]              at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
[portal_customization]              at sun.reflect.GeneratedMethodAccessor329.invoke(Unknown Source)
[portal_customization]              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[portal_customization]              at java.lang.reflect.Method.invoke(Method.java:498)
[portal_customization]              at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
[portal_customization]              at com.sun.proxy.$Proxy84.execute(Unknown Source)
[portal_customization]              at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1146)
[portal_customization]              at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
[portal_customization]              at org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:109)
[portal_customization]              at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:83)
[portal_customization]              at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:73)
[portal_customization]              at org.jenkinsci.plugins.workflow.steps.AbstractSynchronousNonBlockingStepExecution$1$1.call(AbstractSynchronousNonBlockingStepExecution.java:47)
[portal_customization]              at hudson.security.ACL.impersonate(ACL.java:290)
[portal_customization]              at org.jenkinsci.plugins.workflow.steps.AbstractSynchronousNonBlockingStepExecution$1.run(AbstractSynchronousNonBlockingStepExecution.java:44)
[portal_customization]              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[portal_customization]              at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[portal_customization]              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[portal_customization]              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[portal_customization]              ... 1 more
[portal_customization] Caused by: hudson.plugins.git.GitException: Error performing command: git init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/portal_customization
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2023)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1984)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1980)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1612)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$5.execute(CliGitAPIImpl.java:785)
[portal_customization]       ... 12 more
[portal_customization] Caused by: java.io.IOException: Process working directory '/home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/portal_customization' doesn't exist!
[portal_customization]       at hudson.Proc$LocalProc.<init>(Proc.java:247)
[portal_customization]       at hudson.Proc$LocalProc.<init>(Proc.java:218)
[portal_customization]       at hudson.Launcher$LocalLauncher.launch(Launcher.java:936)
[portal_customization]       at hudson.Launcher$ProcStarter.start(Launcher.java:455)
[portal_customization]       at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2012)
[portal_customization]       ... 16 more
[standard] Cloning the remote Git repository
[standard] Cloning repository git@bitbucket.org:tiendung/standard.git
[standard]  > git init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/standard # timeout=10
[standard] ERROR: Error cloning remote repo 'origin'
[standard] hudson.plugins.git.GitException: Could not init /home/jenkins/workspace/DESK/Sample_Check_Out_Parallel/standard
[standard]    at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$5.execute(CliGitAPIImpl.java:787)
[standard]    at org.jenkinsci.plugins.gitclient.CliGitA

       

      Please advise me how to fix the issues.

      Thanks

            Unassigned Unassigned
            tiendungitd Dennis Tran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: