Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-53648

Jenkins stops executing timed and automatic jobs

    Details

    • Similar Issues:

      Description

      I have a Jenkins server running on an EC2 instance with a number of workers running in containers in our data center.  Most of my jobs are either triggered on a timed schedule or are triggered by the Bitbucket pr runner plugin. 

      This system has been running fine for months but recently I've been seeing an issue where the timed jobs and Bitbucket pr jobs have stopped being scheduled.   During this time I can still launch jobs manually.

      This happens 2 or 3 times a day and I don't see any errors in the jekins logs.  Restarting Jenkins will fix it for a few hours but it always returns.

      The jenkins master has 16GB of ram and I've checked that it is never close to using it all. Generally it uses 2-3G.

      I've attached a threadDump taken when this was happening.

      I'm not sure where else to look to debug this so I'd appreciate any advice on what to look for.  Thanks

        Attachments

          Activity

          Hide
          mwarren42 Matt Warren added a comment -

          We are also experiencing this issue in our AWS infrastructure. It seems to happen after a few days of not restarting Jenkins. Not sure what information might be useful here but we would like to help with any path forward.

          Show
          mwarren42 Matt Warren added a comment - We are also experiencing this issue in our AWS infrastructure. It seems to happen after a few days of not restarting Jenkins. Not sure what information might be useful here but we would like to help with any path forward.
          Hide
          rvabdn Richard Veitch added a comment -

          We tracked this down to the bitbucket-pullrequest-builder plugin.

          https://wiki.jenkins.io/display/JENKINS/Bitbucket+pullrequest+builder+plugin

          It gets hung up polling Bitbucket and jenkins grinds to a halt. 

          The best 'fix' we came up with was to remove the plugin and instead use the Bitbucket webhooks to trigger our pr builds.

          Show
          rvabdn Richard Veitch added a comment - We tracked this down to the bitbucket-pullrequest-builder plugin. https://wiki.jenkins.io/display/JENKINS/Bitbucket+pullrequest+builder+plugin It gets hung up polling Bitbucket and jenkins grinds to a halt.  The best 'fix' we came up with was to remove the plugin and instead use the Bitbucket webhooks to trigger our pr builds.
          Hide
          mwarren42 Matt Warren added a comment -

          Oh brilliant. That broke recently for us for other reasons so I'll remove it.

          Show
          mwarren42 Matt Warren added a comment - Oh brilliant. That broke recently for us for other reasons so I'll remove it.

            People

            • Assignee:
              Unassigned
              Reporter:
              rvabdn Richard Veitch
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: