Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-22822

Queue.maintain does disk I/O via PeepholePermalink.resolve

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      https://gist.githubusercontent.com/jglick/de0cf09312d8fce00ab1/raw/gistfile1.txt

      Every time Queue.maintain is called, which is often, for every buildable job in the queue, which could be a lot, Job.getEstimatedDurationCandidates is called. During startup this could do some work loading the last few builds, but we expect those to be held in memory thereafter. However simply finding the last successful/any build involves PeepholePermalink.resolve, which hits the disk every time, with no caching. (It claims to "cache" but this is caching via symlink, not in memory.)

      While we are waiting for the disk I/O operation to complete, the Queue is locked, and lots of other threads will typically be waiting for it.

        Attachments

          Activity

          jglick Jesse Glick created issue -
          abayer Andrew Bayer made changes -
          Field Original Value New Value
          Priority Major [ 3 ] Critical [ 2 ]
          jglick Jesse Glick made changes -
          Assignee Jesse Glick [ jglick ]
          jglick Jesse Glick made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          jglick Jesse Glick made changes -
          Labels lazy-loading performance permalink queue symlink lazy-loading lts-candidate performance permalink queue symlink
          scm_issue_link SCM/JIRA link daemon made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          olivergondza Oliver Gondža made changes -
          Labels lazy-loading lts-candidate performance permalink queue symlink 1.554.3-fixed lazy-loading performance permalink queue symlink
          jglick Jesse Glick made changes -
          Labels 1.554.3-fixed lazy-loading performance permalink queue symlink 1.554.3-fixed lazy-loading lts-candidate performance permalink queue symlink
          olivergondza Oliver Gondža made changes -
          Labels 1.554.3-fixed lazy-loading lts-candidate performance permalink queue symlink 1.554.3-fixed 1.565.1-fixed lazy-loading performance permalink queue symlink
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 154942 ] JNJira + In-Review [ 195091 ]

            People

            • Assignee:
              jglick Jesse Glick
              Reporter:
              jglick Jesse Glick
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: