Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-35254

Thresholds to mark build unstable

    Details

    • Similar Issues:

      Description

      Hi All,

      I am using TestNg plugin for Publishing the Results in Post Build Actions and having hard time configuring Thresholds for marking Build Unstable / failed.

      Because as of now I can either set threshold mode

      1.Number of Tests / 2. Percentage of Test
      for marking build as unstable / failed.

      Which doesn't work for my scenario, which is
      1. Mark build as unstable even single test gets skipped or fails.
      2. Mark build as failed when 100% of test cases fails.
      But due to threshold mode being common among setting build as unstable / failed, I can't have both the options ie; 100% of tests Threshold for marking build as failure and Number of test cases to marking build as unstable.

      If this option is provided as an improvement for this plugin we can handle increasing number of test cases every now and then without manually having to go and give the exact number of test cases for each job as threshold.

      Hope this addition will be helpful to many using this plugin.

      Thanks,
      Pavan

        Attachments

          Activity

          Hide
          nullin Nalin Makar added a comment -

          why not set the unstable threshold to 0% for skipped/failed tests? Won't that solve your use case?

          Show
          nullin Nalin Makar added a comment - why not set the unstable threshold to 0% for skipped/failed tests? Won't that solve your use case?
          Hide
          ppothnis pavan pothnis added a comment -

          It does for current scenario.
          This was just a suggestion, If I want to mark build as unstable if certain number of test fails. This additional option would help.

          Thanks,
          Pavan

          Show
          ppothnis pavan pothnis added a comment - It does for current scenario. This was just a suggestion, If I want to mark build as unstable if certain number of test fails. This additional option would help. Thanks, Pavan

            People

            • Assignee:
              Unassigned
              Reporter:
              ppothnis pavan pothnis
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: