Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-23484

Settings to determine whether failed/ignored/etc tests result in build being marked as failed/unstable/okay

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      Currently, if the NUnit plugin ever sees a failed test, it marks the build as unstable...

      Recording NUnit tests results
      Build step 'Publish NUnit test result report' changed build result to UNSTABLE

      Sometimes I'm okay with failing tests, and want the build to be considered okay, even with failing tests.

      This plugin should allow configuration for that.

        Attachments

          Activity

          Hide
          slide_o_mix Alex Earl added a comment -

          Please file another issue describing exactly what you are looking for.

          Show
          slide_o_mix Alex Earl added a comment - Please file another issue describing exactly what you are looking for.
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Alex Earl
          Path:
          src/main/java/hudson/plugins/nunit/NUnitArchiver.java
          src/main/java/hudson/plugins/nunit/NUnitPublisher.java
          src/main/resources/hudson/plugins/nunit/NUnitPublisher/config.jelly
          src/main/resources/hudson/plugins/nunit/NUnitPublisher/help-healthScaleFactor.html
          src/main/resources/hudson/plugins/nunit/NUnitPublisher/help-healthScaleFactor_ja.html
          src/test/java/hudson/plugins/nunit/NUnitPublisherTest.java
          src/test/java/hudson/plugins/nunit/NUnitReportTransformerTest.java
          src/test/resources/hudson/plugins/nunit/NUnit-healthReport.xml
          src/test/resources/hudson/plugins/nunit/NUnit-issue44315-2.xml
          src/test/resources/hudson/plugins/nunit/NUnit-issue44315-3.xml
          src/test/resources/hudson/plugins/nunit/NUnit-issue47367.xml
          http://jenkins-ci.org/commit/nunit-plugin/129accb1fd732137f9d91ae88e55995208650555
          Log:
          Fix JENKINS-23484

          Added health scale factor

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Alex Earl Path: src/main/java/hudson/plugins/nunit/NUnitArchiver.java src/main/java/hudson/plugins/nunit/NUnitPublisher.java src/main/resources/hudson/plugins/nunit/NUnitPublisher/config.jelly src/main/resources/hudson/plugins/nunit/NUnitPublisher/help-healthScaleFactor.html src/main/resources/hudson/plugins/nunit/NUnitPublisher/help-healthScaleFactor_ja.html src/test/java/hudson/plugins/nunit/NUnitPublisherTest.java src/test/java/hudson/plugins/nunit/NUnitReportTransformerTest.java src/test/resources/hudson/plugins/nunit/NUnit-healthReport.xml src/test/resources/hudson/plugins/nunit/NUnit-issue44315-2.xml src/test/resources/hudson/plugins/nunit/NUnit-issue44315-3.xml src/test/resources/hudson/plugins/nunit/NUnit-issue47367.xml http://jenkins-ci.org/commit/nunit-plugin/129accb1fd732137f9d91ae88e55995208650555 Log: Fix JENKINS-23484 Added health scale factor
          Hide
          slide_o_mix Alex Earl added a comment -

          Will be fixed in 0.22

          Show
          slide_o_mix Alex Earl added a comment - Will be fixed in 0.22
          Hide
          kkkuba Jakub Michalec added a comment -

          How this factors works? I have 1226 tests, failed 155 and build it's unstable with setted 

          • A factor of 10.0 means that 10% of tests failing will score 0% health

          When it's gonna be red?

          Show
          kkkuba Jakub Michalec added a comment - How this factors works? I have 1226 tests, failed 155 and build it's unstable with setted  A factor of  10.0  means that 10% of tests failing will score 0% health When it's gonna be red?
          Hide
          slide_o_mix Alex Earl added a comment -

          Jakub Michalec 

          The functionality is really provided by the junit plugin, I just allow setting and passing a value. Here is the description from the JUnit plugin:

           

          Health report amplification factor: The amplification factor to apply to test failures when computing the test result contribution to the build health score. The default factor is 1.0. A factor of 0.0 will disable the test result contribution to build health score, and, as an example, a factor of 0.5 means that 10% of tests failing will score 95% health. The factor is persisted with the build results, so changes will only be reflected in new builds.
          Show
          slide_o_mix Alex Earl added a comment - Jakub Michalec   The functionality is really provided by the junit plugin, I just allow setting and passing a value. Here is the description from the JUnit plugin:   Health report amplification factor: The amplification factor to apply to test failures when computing the test result contribution to the build health score. The default factor is 1.0. A factor of 0.0 will disable the test result contribution to build health score, and, as an example, a factor of 0.5 means that 10% of tests failing will score 95% health. The factor is persisted with the build results, so changes will only be reflected in new builds.

            People

            • Assignee:
              slide_o_mix Alex Earl
              Reporter:
              balfa Mo Cassidy
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: