-
Bug
-
Resolution: Unresolved
-
Major
-
Using Jenkins ver. 1.625.2
We have noticed a bug when using the plugin. Even thou there are tests that fails we still get a green light and the message that no test failed.
As seen in the images below the plot indicates that the number of tests is one (highlighted in blue) and green result. But as shown in the test result image we can see that in fact there where three tests and one that failed.
If I take the difference between the graph and actual number of tests, e.g 41 tests, I can always sum up that value from the last splits in the console output. Like in one project with 41 missing tests, the five last splits (out of ten) looked like this (7 + 11 + 6 + 10 + 7 = 41). In another case the difference was only 2 and the last split contained two tests. This type of behavior was consistent to all builds with missing tests.