Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-29316

MSTEST : inconclusive tests are reported as 'failed' instead of 'skipped'

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Component/s: mstest-plugin
    • Labels:
      None
    • Environment:
      jenkins 1.598 / MSTest plugin 0.18
    • Similar Issues:

      Description

      since update from 0.11 plugin version, 'inconclusive' tests status has changed from 'success' to 'fail' whereas right status is actually 'skipped'.

      Job is 'UNSTABLE' and not 'FAILED' which is correct and contradictory with detailed results where inconclusive are in 'failed tests' section.

      Is it possible to fix this please ?

        Attachments

          Activity

          Hide
          splashnenen Alexandre Aubert added a comment -

          job status 'STABLE/SUCCESS' with inconclusive tests as 'skipped' tests would be perfect and reflecting well the reality

          Show
          splashnenen Alexandre Aubert added a comment - job status 'STABLE/SUCCESS' with inconclusive tests as 'skipped' tests would be perfect and reflecting well the reality
          Hide
          nilleb Ivo Bellin Salarin added a comment -

          Alexandre, would you please send me an example TRX, in order to add it to the unit test material?

          Show
          nilleb Ivo Bellin Salarin added a comment - Alexandre, would you please send me an example TRX, in order to add it to the unit test material?
          Hide
          splashnenen Alexandre Aubert added a comment -

          Sorry for the late reply, here is the requested file. You may check that there are 116 failed tests and 6 inconclusive. Jenkins displays '122 failed' as build result. (instead of 116 failed, 6 skipped)
          Thanks for your help on that

          Show
          splashnenen Alexandre Aubert added a comment - Sorry for the late reply, here is the requested file. You may check that there are 116 failed tests and 6 inconclusive. Jenkins displays '122 failed' as build result. (instead of 116 failed, 6 skipped) Thanks for your help on that
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: nilleb
          Path:
          src/main/resources/hudson/plugins/mstest/mstest-to-junit.xsl
          src/test/java/hudson/plugins/mstest/MSTestReportConverterTest.java
          src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.trx
          src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.xml
          http://jenkins-ci.org/commit/mstest-plugin/11249bc882314d8f1daa4a76099b499ad7608e85
          Log:
          JENKINS-29316 mark inconclusive tests as 'skipped'

          Compare: https://github.com/jenkinsci/mstest-plugin/compare/9414e939465a...11249bc88231

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: nilleb Path: src/main/resources/hudson/plugins/mstest/mstest-to-junit.xsl src/test/java/hudson/plugins/mstest/MSTestReportConverterTest.java src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.trx src/test/resources/hudson/plugins/mstest/DATAFEED.Tests.xml http://jenkins-ci.org/commit/mstest-plugin/11249bc882314d8f1daa4a76099b499ad7608e85 Log: JENKINS-29316 mark inconclusive tests as 'skipped' Compare: https://github.com/jenkinsci/mstest-plugin/compare/9414e939465a...11249bc88231
          Hide
          splashnenen Alexandre Aubert added a comment -

          Do you have an estimate for next release of the plugin ?
          Thanks

          Show
          splashnenen Alexandre Aubert added a comment - Do you have an estimate for next release of the plugin ? Thanks
          Hide
          nilleb Ivo Bellin Salarin added a comment -

          This has been fixed in the 0.19 version of the plugin (published 2015/09/01)

          Show
          nilleb Ivo Bellin Salarin added a comment - This has been fixed in the 0.19 version of the plugin (published 2015/09/01)

            People

            • Assignee:
              nilleb Ivo Bellin Salarin
              Reporter:
              splashnenen Alexandre Aubert
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: