-
Bug
-
Resolution: Incomplete
-
Minor
-
None
-
Jenkins ver. 2.73.1
xUnit plugin 1.102
I have a test fixture FixtureA, which is a part of a namespace NameSpaceA with three tests inside the fixture: TestA, TestB, and TestC.
TestA and TestB run for 1 minute each, and TestC runs for 2 minutes.
To optimize the execution time, I use two slaves and mark TestC with attribute [Category("Separate")].
Then, slaves execute two different commands:
nunit-console.exe my.dll --run=NameSpaceA.FixtureA --exclude=Separate nunit-console.exe my.dll --run=NameSpaceA.FixtureA.TestC
So, the first slave will run TestA and TestB for 2 minutes in total, while the second slave will only run TestC also for 2 minutes.
The test results table I expect:
| Package | Duration (my expectation) | Duration (what I get) |
|---|---|---|
| NameSpaceA | 4 mins | 4 mins |
So far so good. Then, I click NameSpaceA:
| Class | Duration (my expectation) | Duration (what I get) |
|---|---|---|
| FixtureA | 4 mins | 2 mins |
Then, if I click FixtureA to go even deeper:
| Test name | Duration (my expectation) | Duration (what I get) |
|---|---|---|
| TestA | 1 min | 1 min |
| TestB | 1 min | 1 min |
| TestC | 2 min | 2 min |
So, the duration at the middle (class) level is the duration of the test that ran last and separately from the other tests in the same test fixture. However, it should be the sum of durations within this fixture just like it is at the most top level (package).
