Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-15747

Logging all UpstreamCause's floods Jenkins in large setups

    Details

    • Similar Issues:

      Description

      In version 1.482 the feature "Report root causes of UpstreamCause in log and status pages" has been added. In certain scenarios (as stated below) this is absolutely not feasible because the amount of data logged per build might become dozens of megabytes. The result is that the jobs folder grows for several thousand builds in tens of gigabytes (within a couple of hours) which lets Jenkins hit memory limits and become unusable.

      Some more words on the scenario which shows that problem. We have a Jenkins instance with 30 executors, and about 5000 jobs. I think the specific thing is that these jobs are not independent (or slightly connected) but have a lot of up/downstream relationships. The problem is that when Jenkins hits one of the leaf jobs the list of hierarchic causes which triggered that job is tens of megabytes long (I am not attaching a full log I guess the content is pretty obvious). On the one hand because the nesting level is very high and on the other hand since there are several paths through the dependency graph.

      So there is an urgent need to optionally disable that feature. It basically makes Jenkins unusable in such scenarios.

        Attachments

          Issue Links

            Activity

            dthomas Dirk Thomas created issue -
            jglick Jesse Glick made changes -
            Field Original Value New Value
            Labels performance
            jglick Jesse Glick made changes -
            Link This issue is related to JENKINS-14814 [ JENKINS-14814 ]
            jglick Jesse Glick made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            scm_issue_link SCM/JIRA link daemon made changes -
            Status In Progress [ 3 ] Resolved [ 5 ]
            Resolution Fixed [ 1 ]
            jglick Jesse Glick made changes -
            Labels performance 1.480.4-candidate performance
            jglick Jesse Glick made changes -
            Labels 1.480.4-candidate performance lts-candidate performance
            vjuranek vjuranek made changes -
            Labels lts-candidate performance 1.509.1-fixed performance
            jglick Jesse Glick made changes -
            Link This issue depends on JENKINS-21605 [ JENKINS-21605 ]
            rtyler R. Tyler Croy made changes -
            Workflow JNJira [ 146548 ] JNJira + In-Review [ 191969 ]

              People

              • Assignee:
                Unassigned
                Reporter:
                dthomas Dirk Thomas
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: