Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-6446

Unit test rules should be symmetric

    Details

    • Similar Issues:

      Description

      Currently the failed test rule and the passed test rule are not symmetric.
      The failed test rule only gives points only for new failed test and the passed test rule only for new passed tests.
      I.e. skipped test are lost along the way.
      Example:
      Build n : SUCCESS, 610 passing tests
      Build n+1: UNSTABLE, 71 passing, 67 failed, 2963 skipped tests (TestNG has the strange behaviour that when the init of some test classes fails, the skipped count sky-rockets)
      Build n+2: SUCCESS, 610 passing tests

      Build n+1 gives 71 minus points
      Build n+2 gives 539 plus points

      So, by breaking the build and fixing it again you can 'unrightfully' get lots of points

        Attachments

          Activity

          kutzi kutzi created issue -
          kutzi kutzi made changes -
          Field Original Value New Value
          Assignee redsolo [ redsolo ] kutzi [ kutzi ]
          lkamal Kamal Mettananda made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          kutzi kutzi made changes -
          Assignee kutzi [ kutzi ]
          lkamal Kamal Mettananda made changes -
          Assignee Kamal Mettananda [ lkamal ]
          lkamal Kamal Mettananda made changes -
          Remote Link This issue links to "Created a pull request for the fix (Web Link)" [ 10601 ]
          lkamal Kamal Mettananda made changes -
          Attachment CI-Game-UnitTest-Points.png [ 24571 ]
          scm_issue_link SCM/JIRA link daemon made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          rtyler R. Tyler Croy made changes -
          Workflow JNJira [ 136541 ] JNJira + In-Review [ 187225 ]

            People

            • Assignee:
              lkamal Kamal Mettananda
              Reporter:
              kutzi kutzi
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: