I have a jenkins job run builds conccurently, but the agent connction timout happened after 27 conccurent builds created. There are only 27 agent pods online, the other agent are just timeout and offline.

My Concurrency Limit setting in Kubernetes plugin and the pod template are empty, which means no limit for the concurrent agent pods.

 

2019-09-18 08:15:32.507+0000 [id=8704] WARNING o.c.j.p.k.KubernetesLauncher#launch: Error in provisioning; agent=Kubern
etesSlave name: test3-183-6j55c-xmhx3-g56pb, template=PodTemplate

{, name='Test3_183-6j55c-xmhx3', namespace='jenkins', l abel='Test3_183-6j55c', nodeUsageMode=EXCLUSIVE, annotations=[org.csanchez.jenkins.plugins.kubernetes.PodAnnotation@aab9 c821]}

io.fabric8.kubernetes.client.KubernetesClientTimeoutException: Timed out waiting for [100000] milliseconds for [Pod] with name:[test3-183-6j55c-xmhx3-g56pb] in namespace [jenkins].
at org.csanchez.jenkins.plugins.kubernetes.AllContainersRunningPodWatcher.await(AllContainersRunningPodWatcher.j
ava:130)
at org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:131)
at hudson.slaves.SlaveComputer$1.call(SlaveComputer.java:297)
at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019-09-18 08:15:32.508+0000 [id=8704] INFO o.c.j.p.k.KubernetesSlave#_terminate: Terminating Kubernetes instance fo
r agent test3-183-6j55c-xmhx3-g56pb
2019-09-18 08:15:32.526+0000 [id=77] INFO o.c.j.p.k.pod.retention.Reaper#eventReceived: jenkins/test3-183-6j55c-xm
hx3-g56pb was just deleted, so removing corresponding Jenkins agent
2019-09-18 08:15:32.527+0000 [id=8704] INFO o.c.j.p.k.KubernetesSlave#deleteSlavePod: Terminated Kubernetes instance
for agent jenkins/test3-183-6j55c-xmhx3-g56pb
Terminated Kubernetes instance for agent jenkins/test3-183-6j55c-xmhx3-g56pb
2019-09-18 08:15:32.527+0000 [id=8704] INFO o.c.j.p.k.KubernetesSlave#_terminate: Disconnected computer test3-183-6j
55c-xmhx3-g56pb
Disconnected computer test3-183-6j55c-xmhx3-g56pb