Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-37091

Ignored failure, green light despite failed tests

XMLWordPrintable

      We have noticed a bug when using the plugin. Even thou there are tests that fails we still get a green light and the message that no test failed.

      As seen in the images below the plot indicates that the number of tests is one (highlighted in blue) and green result. But as shown in the test result image we can see that in fact there where three tests and one that failed.

      If I take the difference between the graph and actual number of tests, e.g 41 tests, I can always sum up that value from the last splits in the console output. Like in one project with 41 missing tests, the five last splits (out of ten) looked like this (7 + 11 + 6 + 10 + 7 = 41). In another case the difference was only 2 and the last split contained two tests. This type of behavior was consistent to all builds with missing tests.

        1. test-result.PNG
          7 kB
          Markus Axelsson
        2. plot.PNG
          10 kB
          Markus Axelsson

            Unassigned Unassigned
            max_hms Markus Axelsson
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: