Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-19868

Jenkins windows service terminates unexpectedly

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Blocker
    • Resolution: Unresolved
    • Labels:
      None
    • Environment:
    • Similar Issues:

      Description

      Jenkins 1.533
      MSBuild Plugin Version:1.20
      VSS Plugin Version: 1.9
      Visual Source Safe Version 8.0
      Further environment details are posted in the environment box above.

      The Jenkins windows service crashes on the above configuration during the creation manual build. The issue occurs at a stage during the manual build process when the Console Output is displaying the message "[get] Getting source code from:[Project]".

      The windows event log related to this issue is attached"EventViewerLog.txt".

        Attachments

          Activity

          Hide
          paulbussmann Paul Bußmann added a comment -
          • Test with big project (1 924 files, 340 folders, 56MB) fails after getting files. (Crashes with Exception code 0xc0000374 heap corruption)
          • Test with small project (69 files, 25 folders, 1MB) passes getting files.
          • Increasing heap in C:\Program Files (x86)\Jenkins\jenkins.xml to e.g. "-Xmx1024m" is unfortunately too much limited (does not work-around my issue). Reason: Jenkins runs with 32 bit JRE, only.
          • Trying to run with 64 bit JRE fails with "C:\Program Files (x86)\Jenkins\plugins\vss\WEB-INF\lib\com4j.dll: Can't load IA 32-bit .dll on a AMD 64-bit platform".
            -> Cause to heap corruption still unclear and cannot be worked-around. Please help.
          Show
          paulbussmann Paul Bußmann added a comment - Test with big project (1 924 files, 340 folders, 56MB) fails after getting files. (Crashes with Exception code 0xc0000374 heap corruption) Test with small project (69 files, 25 folders, 1MB) passes getting files. Increasing heap in C:\Program Files (x86)\Jenkins\jenkins.xml to e.g. "-Xmx1024m" is unfortunately too much limited (does not work-around my issue). Reason: Jenkins runs with 32 bit JRE, only. Trying to run with 64 bit JRE fails with "C:\Program Files (x86)\Jenkins\plugins\vss\WEB-INF\lib\com4j.dll: Can't load IA 32-bit .dll on a AMD 64-bit platform". -> Cause to heap corruption still unclear and cannot be worked-around. Please help.
          Hide
          oleg_nenashev Oleg Nenashev added a comment -

          Fixed the component though I am not sure I can diagnose it with available info
          Paul Bußmann reports that something it not running on 64bit, because the code somehow determines amd64 as Itanium machine. Not sure what to do there

          Show
          oleg_nenashev Oleg Nenashev added a comment - Fixed the component though I am not sure I can diagnose it with available info Paul Bußmann reports that something it not running on 64bit, because the code somehow determines amd64 as Itanium machine. Not sure what to do there
          Hide
          ajaydwarkani Ajay Kumar added a comment - - edited

          I am too experiencing this problem. Please find the windows event log details attached.

          Jenkins ver. 2.60.2
          Windows slave, version 3.2
          Java memory used: 51 Mb / 1,365 Mb
           

          OS:  Windows 10, , amd64/64 (8 cores)
          Java: Java(TM) SE Runtime Environment, 1.8.0_144-b01
          JVM: Java HotSpot(TM) 64-Bit Server VM, 25.144-b01, mixed mode
          PID of process: 10624
          Start: 8/16/17 4:49 AM
          JVM arguments: -Xrs
          -Xmx1536m
          Memory: Non heap memory = 40 Mb (Perm Gen, Code Cache),
          Buffered memory = 0 Mb,
          Loaded classes = 3,924,
          Garbage collection time = 15,870 ms,
          Process cpu time = 3,365,171 ms,
          Committed virtual memory = 934 Mb,
          Free physical memory = 25,554 Mb,
          Total physical memory = 32,767 Mb,
          Free swap space = 31,579 Mb,
          Total swap space = 37,631 Mb
          Free disk space: 14,490 Mb

          Let me know if you need any more details.

          Show
          ajaydwarkani Ajay Kumar added a comment - - edited I am too experiencing this problem. Please find the windows event log details attached. Jenkins ver. 2.60.2 Windows slave, version 3.2 Java memory used: 51 Mb / 1,365 Mb   OS:  Windows 10, , amd64/64 (8 cores) Java: Java(TM) SE Runtime Environment, 1.8.0_144-b01 JVM: Java HotSpot(TM) 64-Bit Server VM, 25.144-b01, mixed mode PID of process: 10624 Start: 8/16/17 4:49 AM JVM arguments: -Xrs -Xmx1536m Memory: Non heap memory = 40 Mb (Perm Gen, Code Cache), Buffered memory = 0 Mb, Loaded classes = 3,924, Garbage collection time = 15,870 ms, Process cpu time = 3,365,171 ms, Committed virtual memory = 934 Mb, Free physical memory = 25,554 Mb, Total physical memory = 32,767 Mb, Free swap space = 31,579 Mb, Total swap space = 37,631 Mb Free disk space: 14,490 Mb Let me know if you need any more details.
          Hide
          oleg_nenashev Oleg Nenashev added a comment -

          Ajay Kumarfor such error there should also be a crashdump somewhere

          Show
          oleg_nenashev Oleg Nenashev added a comment - Ajay Kumar for such error there should also be a crashdump somewhere
          Hide
          ajaydwarkani Ajay Kumar added a comment -

          Oleg Nenashev, Currently I don't see the crashdump under C:\Windows, but I will find and attach it when the event occurs again.

          Show
          ajaydwarkani Ajay Kumar added a comment - Oleg Nenashev , Currently I don't see the crashdump under C:\Windows, but I will find and attach it when the event occurs again.
          Hide
          piratess Piotr Michalowski added a comment - - edited

          I'm observing the same issue on my Jenkins master when I increase Xmx above 1g. Unfortunately I need more than that as some jobs are failing with java.lang.OutOfMemoryError: Java heap space.

          Example event from even viewer:

          Child process [12716 - C:\Jenkins\jre\bin\java -Xrs -Xmx8g -XX:MaxPermSize=512m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "C:\Jenkins\jenkins.war" --httpPort=8080 --webroot="C:\Jenkins\war"] finished with 1

           

          I'm using Jenkins 2.138.2 on Windows Server 2012r2

          Show
          piratess Piotr Michalowski added a comment - - edited I'm observing the same issue on my Jenkins master when I increase Xmx above 1g. Unfortunately I need more than that as some jobs are failing with java.lang.OutOfMemoryError: Java heap space. Example event from even viewer: Child process [12716 - C:\Jenkins\jre\bin\java -Xrs -Xmx8g -XX:MaxPermSize=512m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "C:\Jenkins\jenkins.war" --httpPort=8080 --webroot="C:\Jenkins\war"] finished with 1   I'm using Jenkins 2.138.2 on Windows Server 2012r2
          Hide
          laurin1 Keith Davis added a comment -

          I'm not sure what I can add here, but ours was completely stable until a few months ago, but now is increasingly failing. Usually a few times a week, but sometimes more than once a day. This week it crashed in the middle of a deployment and only partially completed the job, but the job did not even indicate that it ever ran!

          Child process [2636 - c:\Jenkins\jre\bin\java -Xrs -Xmx256m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "c:\Jenkins\jenkins.war" --httpPort=9999] finished with -1073741510

          Show
          laurin1 Keith Davis added a comment - I'm not sure what I can add here, but ours was completely stable until a few months ago, but now is increasingly failing. Usually a few times a week, but sometimes more than once a day. This week it crashed in the middle of a deployment and only partially completed the job, but the job did not even indicate that it ever ran! Child process [2636 - c:\Jenkins\jre\bin\java -Xrs -Xmx256m -Dhudson.lifecycle=hudson.lifecycle.WindowsServiceLifecycle -jar "c:\Jenkins\jenkins.war" --httpPort=9999] finished with -1073741510

            People

            • Assignee:
              kdsweeney kdsweeney
              Reporter:
              umer_qureshi umer qureshi
            • Votes:
              3 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated: