Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-44380

Removing big number GCE nodes hangs up jenkins

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Component/s: jclouds-plugin
    • Labels:
      None
    • Environment:
      Jenkins ver. 2.46.2
      JCloud 2.14
    • Similar Issues:

      Description

      We use about 100 nodes for provisioning on GCE. Job run tests in parallel and a lot of nodes (60) made simultaneously. Then jcloud trying remove them and did it one after the other. It take time. And during this time no one job can be run.

        Attachments

          Activity

          Hide
          dubrsl Viacheslav Dubrovskyi added a comment -

          There are 2 questions:
          1. Why it remove nodes one by one? And not all together?
          2. Why it can't start other jobs when removing nodes?

          Show
          dubrsl Viacheslav Dubrovskyi added a comment - There are 2 questions: 1. Why it remove nodes one by one? And not all together? 2. Why it can't start other jobs when removing nodes?
          Hide
          tommywo Tomasz Wojtun added a comment -

          This is a regression from fix for JENKINS-28403, commit f141bc7633987e691856e4c20af6dd262e27f9c1.

          RetentionStrategy.check(Computer c) is @GuardedBy("hudson.model.Queue.lock"), so queue is locked. 

          Show
          tommywo Tomasz Wojtun added a comment - This is a regression from fix for JENKINS-28403 , commit f141bc7633987e691856e4c20af6dd262e27f9c1. RetentionStrategy.check(Computer c) is @GuardedBy("hudson.model.Queue.lock"), so queue is locked. 

            People

            • Assignee:
              felfert Fritz Elfert
              Reporter:
              dubrsl Viacheslav Dubrovskyi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: