if a single config fails , the naginator reruns all the possible combinations.
An option should be given if one wants to run all the configs again or only the failed config.