Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17960

Indicate if tests don't go to plan

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      One of the major features of TAP is that you have a test plan.
      If my TAP starts 1..100, but only 5 results are recorded before something broke, then I want to know about it. Likewise, if 105 results are recorded, I want some kind of error indication.

      I suggest counting this as 95 skipped tests by default, possibly with an config option to treat them as failed instead.

        Attachments

          Activity

          Hide
          kinow Bruno P. Kinoshita added a comment -

          Due to firewall policies in the office where I am atm I can't release an alpha version to the experimental update center

          I've attached a snapshot HPI with the latest code though, don't know if you can install it in some environment and try it. If so let me know if that works and feel free to update this issue.

          JENKINS-17960 is the only pending issue I'm waiting to cut a new release. Next release will focus in JVM crashes and memory management, and the following will be code review/smaller improvements.

          Thanks!
          Bruno

          Show
          kinow Bruno P. Kinoshita added a comment - Due to firewall policies in the office where I am atm I can't release an alpha version to the experimental update center I've attached a snapshot HPI with the latest code though, don't know if you can install it in some environment and try it. If so let me know if that works and feel free to update this issue. JENKINS-17960 is the only pending issue I'm waiting to cut a new release. Next release will focus in JVM crashes and memory management, and the following will be code review/smaller improvements. Thanks! Bruno
          Hide
          kinow Bruno P. Kinoshita added a comment -

          TAP Plug-in snapshot 2014-03-12 HPI file

          Show
          kinow Bruno P. Kinoshita added a comment - TAP Plug-in snapshot 2014-03-12 HPI file
          Hide
          jameshowe James Howe added a comment -

          This looks like it now works as I would expect.

          Show
          jameshowe James Howe added a comment - This looks like it now works as I would expect.
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Yay, thanks for testing it so quickly James. Cutting a new release this night, 1.18 should be available in the update center within hours.

          Thanks again
          Bruno

          Show
          kinow Bruno P. Kinoshita added a comment - Yay, thanks for testing it so quickly James. Cutting a new release this night, 1.18 should be available in the update center within hours. Thanks again Bruno
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Fixed in 1.18

          Show
          kinow Bruno P. Kinoshita added a comment - Fixed in 1.18

            People

            • Assignee:
              kinow Bruno P. Kinoshita
              Reporter:
              jameshowe James Howe
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: