Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-16095

Heap memory leak (possibly jclouds plugin related)

    Details

    • Similar Issues:

      Description

      We're running into a memory leak that might be related to the jclouds plugin. Running with a heap of 5.5gb, old gen becomes full after a couple of days with moderate to heavy load.

      We have a setup with jenkins & jclouds provisioning test instances on a private nova-compute cloud.

      When I look at the heap dump it seems that there's a guava cache that occupies 70% of the heap. Any idea how to proceed debugging this?

      This is jeknins 1.492, jclouds plugin 2.3.1

        Attachments

        1. screenshot-leak.png
          screenshot-leak.png
          98 kB
        2. screenshot-leak2.png
          screenshot-leak2.png
          79 kB
        3. screenshot-leak3.png
          screenshot-leak3.png
          185 kB
        4. screenshot-leak-4.png
          screenshot-leak-4.png
          51 kB
        5. screenshot-leak-5.png
          screenshot-leak-5.png
          214 kB

          Activity

          Hide
          abayer Andrew Bayer added a comment -

          Lemme see what other jclouds people think.

          Show
          abayer Andrew Bayer added a comment - Lemme see what other jclouds people think.
          Hide
          onemanbucket onemanbucket added a comment -

          Ok cool. There's a lot of reflect.Method objects (1.2gb shallow heap) that are cached by jclouds if that could help investigate this further. Attaching 2 more screenshots.

          Show
          onemanbucket onemanbucket added a comment - Ok cool. There's a lot of reflect.Method objects (1.2gb shallow heap) that are cached by jclouds if that could help investigate this further. Attaching 2 more screenshots.
          Hide
          onemanbucket onemanbucket added a comment -

          abayer, did you check with the jclouds people? Is there anything else I can do to help?

          Show
          onemanbucket onemanbucket added a comment - abayer, did you check with the jclouds people? Is there anything else I can do to help?
          Hide
          onemanbucket onemanbucket added a comment -

          After discussion on IRC this should be solved in jclouds 1.6. I'll do some testing and post results here

          Show
          onemanbucket onemanbucket added a comment - After discussion on IRC this should be solved in jclouds 1.6. I'll do some testing and post results here
          Hide
          onemanbucket onemanbucket added a comment -

          We've used a jclouds-plugin build based on jclouds 1.6.0-snapshot, for a week now and the leak seems to be gone.

          Show
          onemanbucket onemanbucket added a comment - We've used a jclouds-plugin build based on jclouds 1.6.0-snapshot, for a week now and the leak seems to be gone.
          Hide
          danielbeck Daniel Beck added a comment -

          Most recent comment indicates this was resolved long ago.

          Show
          danielbeck Daniel Beck added a comment - Most recent comment indicates this was resolved long ago.

            People

            • Assignee:
              abayer Andrew Bayer
              Reporter:
              onemanbucket onemanbucket
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: