Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-27042

java.util.zip.ZipException thrown when reading artifacts from archive larger than 4G

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      When overall archive size reaches 4G, serving (though not listing) artifacts throws an exception. On jdk 7 and 8, some files are downloaded fine, some throws "error reading zip file" and some "invalid LOC header (bad signature)".

      java.util.zip.ZipException: error reading zip file
      	at java.util.zip.ZipFile.read(Native Method)
      	at java.util.zip.ZipFile.access$1400(ZipFile.java:61)
      	at java.util.zip.ZipFile$ZipFileInputStream.read(ZipFile.java:717)
      	at java.util.zip.ZipFile$ZipFileInflaterInputStream.fill(ZipFile.java:420)
      	at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
      	at java.io.FilterInputStream.read(FilterInputStream.java:133)
      	at java.io.FilterInputStream.read(FilterInputStream.java:107)
      	at org.kohsuke.stapler.Stapler.serveStaticResource(Stapler.java:584)
      	at org.kohsuke.stapler.ResponseImpl.serveFile(ResponseImpl.java:215)
      	at hudson.model.DirectoryBrowserSupport.serveFile(DirectoryBrowserSupport.java:310)
      	at hudson.model.DirectoryBrowserSupport.generateResponse(DirectoryBrowserSupport.java:123)
      	at org.kohsuke.stapler.HttpResponseRenderer$Default.handleHttpResponse(HttpResponseRenderer.java:124)
      	at org.kohsuke.stapler.HttpResponseRenderer$Default.generateResponse(HttpResponseRenderer.java:69)
      	at org.kohsuke.stapler.Function.renderResponse(Function.java:113)
      	at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:98)
      	at org.kohsuke.stapler.MetaClass$1.doDispatch(MetaClass.java:121)
      	at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53)
      	at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
      	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
      	at org.kohsuke.stapler.MetaClass$12.dispatch(MetaClass.java:391)
      	at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
      	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
      	at org.kohsuke.stapler.MetaClass$6.doDispatch(MetaClass.java:249)
      	at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:53)
      	at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
      	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
      	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649)
      	at org.kohsuke.stapler.Stapler.service(Stapler.java:238)
      	at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
      	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:686)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1494)
      	at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:96)
      	at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:88)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
      	at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:48)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
      	at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
      	at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76)
      	at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:164)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
      	at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:49)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
      	at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:81)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1482)
      	at org.kohsuke.stapler.DiagnosticThreadNameFilter.doFilter(DiagnosticThreadNameFilter.java:30)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1474)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:499)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:533)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:428)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
      	at org.eclipse.jetty.server.Server.handle(Server.java:370)
      	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
      	at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:949)
      	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1011)
      	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644)
      	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
      	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
      	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668)
      	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
      	at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      

      However on Oracle JDK 6.0_45-b06 whole JVM crashes with SIGSEGV (JDK-8017777).

      # A fatal error has been detected by the Java Runtime Environment:
      #
      #  SIGSEGV (0xb) at pc=0x00007f6845b581f0, pid=11835, tid=140082707166976
      #
      # JRE version: 6.0_45-b06
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.45-b01 mixed mode linux-amd64 compressed oops)
      # Problematic frame:
      # C  [libzip.so+0xb1f0]  __int128+0x60
      #
      # An error report file with more information is saved as:
      # /mnt/hudson_workspace/workspace/JENKINS-27042/eb0dfba6/hs_err_pid11835.log
      #
      # If you would like to submit a bug report, please visit:
      #   http://java.sun.com/webapps/bugreport/crash.jsp
      # The crash happened outside the Java Virtual Machine in native code.
      # See problematic frame for where to report the bug.
      

        Attachments

          Issue Links

            Activity

            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Oliver Gondža
            Path:
            pom.xml
            src/main/java/org/jenkinsci/plugins/compress_artifacts/ZipStorage.java
            src/test/java/org/jenkinsci/plugins/compress_artifacts/CompressArtifactsTest.java
            http://jenkins-ci.org/commit/compress-artifacts-plugin/f56397d468dfc7b14be30ca7097855c281db8045
            Log:
            Merge pull request #5 from olivergondza/truezip

            [FIX JENKINS-27042] Use TrueZIP to access archive

            Compare: https://github.com/jenkinsci/compress-artifacts-plugin/compare/f33ad894f0d2...f56397d468df

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oliver Gondža Path: pom.xml src/main/java/org/jenkinsci/plugins/compress_artifacts/ZipStorage.java src/test/java/org/jenkinsci/plugins/compress_artifacts/CompressArtifactsTest.java http://jenkins-ci.org/commit/compress-artifacts-plugin/f56397d468dfc7b14be30ca7097855c281db8045 Log: Merge pull request #5 from olivergondza/truezip [FIX JENKINS-27042] Use TrueZIP to access archive Compare: https://github.com/jenkinsci/compress-artifacts-plugin/compare/f33ad894f0d2...f56397d468df
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Oliver Gondža
            Path:
            src/test/java/plugins/CompressArtifactsPluginTest.java
            http://jenkins-ci.org/commit/acceptance-test-harness/76d4c256df3f7e3b4cbaca6cdb239c4b7f723c11
            Log:
            JENKINS-27042 Reproduce in test

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oliver Gondža Path: src/test/java/plugins/CompressArtifactsPluginTest.java http://jenkins-ci.org/commit/acceptance-test-harness/76d4c256df3f7e3b4cbaca6cdb239c4b7f723c11 Log: JENKINS-27042 Reproduce in test
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Oliver Gondža
            Path:
            src/test/java/plugins/CompressArtifactsPluginTest.java
            http://jenkins-ci.org/commit/acceptance-test-harness/a930950388ebfb175e371663f1e5c28821c30a72
            Log:
            Merge pull request #21 from olivergondza/JENKINS-27042

            Reproduce JENKINS-27042

            Compare: https://github.com/jenkinsci/acceptance-test-harness/compare/ff52a91d1067...a930950388eb

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oliver Gondža Path: src/test/java/plugins/CompressArtifactsPluginTest.java http://jenkins-ci.org/commit/acceptance-test-harness/a930950388ebfb175e371663f1e5c28821c30a72 Log: Merge pull request #21 from olivergondza/ JENKINS-27042 Reproduce JENKINS-27042 Compare: https://github.com/jenkinsci/acceptance-test-harness/compare/ff52a91d1067...a930950388eb
            Hide
            olivergondza Oliver Gondža added a comment -

            Fixed in 1.4

            Show
            olivergondza Oliver Gondža added a comment - Fixed in 1.4
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Oliver Gondža
            Path:
            src/main/java/org/jenkinsci/plugins/compress_artifacts/TrueZipArchiver.java
            src/main/java/org/jenkinsci/plugins/compress_artifacts/ZipStorage.java
            http://jenkins-ci.org/commit/compress-artifacts-plugin/6f6932c8712602c9760d8a7e7eb26a06c676a8df
            Log:
            JENKINS-28862JENKINS-27042 Perform archiving using truezip via one remoting roundtrip.

            JENKINS-28862 was resolved so it introduced a regression for JENKINS-27042
            in 1.6. Now both should be resolved implementing hudson.util.io.Archiver,
            based on truezip.

            Compare: https://github.com/jenkinsci/compress-artifacts-plugin/compare/af852f71458e...6f6932c87126

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oliver Gondža Path: src/main/java/org/jenkinsci/plugins/compress_artifacts/TrueZipArchiver.java src/main/java/org/jenkinsci/plugins/compress_artifacts/ZipStorage.java http://jenkins-ci.org/commit/compress-artifacts-plugin/6f6932c8712602c9760d8a7e7eb26a06c676a8df Log: JENKINS-28862 JENKINS-27042 Perform archiving using truezip via one remoting roundtrip. JENKINS-28862 was resolved so it introduced a regression for JENKINS-27042 in 1.6. Now both should be resolved implementing hudson.util.io.Archiver, based on truezip. Compare: https://github.com/jenkinsci/compress-artifacts-plugin/compare/af852f71458e...6f6932c87126

              People

              • Assignee:
                olivergondza Oliver Gondža
                Reporter:
                olivergondza Oliver Gondža
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: