Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-69415

[pipeline-groovy-lib] /libs folder of every build clogs up file system

XMLWordPrintable

      Hello, we have a lot of jobs running on our jenkins and each job (mostly multi-branch pipelines) are using multiple libraries. The libraries are downloaded from GitHub and configured to all download the same default version. We now face the issue that everytime a build is started each library seems to be re-downloaded from GitHub into the individual build directories, say:

      /var/jenkins_home/jobs/<name>/branches/main/builds/46/libs/...
      /var/jenkins_home/jobs/<name>/branches/main/builds/47/libs/...
      ...
      

      As some libraries come with hundrets of files, we have hundrets of jobs, that do hundrets of builds, that results in literally millions of duplicated files on our Jenkins clogging up the whole file system. At that is even if the version of the libraries in question do not change between build the same library is downloaded all over again for every build.

      Is there a way to prevent this massive duplication of files between builds, like a way to clone the library to a central folder on Jenkins instead of the individual build directories instead? Thanks!

            Unassigned Unassigned
            kriskra Kristian Kraljic
            Votes:
            2 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: