Now, the last successful job (out of 10) is used to create the new test distribution. We want to migrate to this Plugin but get irreproducible faults. Probably our tests are not independent or are very sensitive to runtime. In order to resolve these issues it would be necessary to reproduce the exact same test distribution several times. It would be also helpful if you ran an old commit or guarantees comparability if you want to run one commit on different environments.

Additionally we have several teams implementing different components that could share one Jenkins job then. Otherwise they would have to wait longer because their new tests run on all batches.