Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-14263

TestLink Plugin: Jenkins reports build failure when test case is failed

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      I'm building QA environment where test cases can be managed in TestLink and automated tests can be executed using Jenkins.

      I have followed instructions in 'Jenkins TestLink Plug-in Tutorial' to execute automated tests.

      http://tupilabs.com/books/jenkins-testlink-plugin-tutorial/en/

      Jenkins successfully exectuted 'Test Current time' test case and its status is marked as 'Passed' in TestLink

      When 'Test Current time' fails, it results in build failure (see Jenkins console output below) and failure is not reported to TestLink.

      -------------------------------------------------------
      T E S T S
      -------------------------------------------------------
      Running jenkins.plugins.testlink.examples.TestCurrentTime
      Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.563 sec <<< FAILURE!

      Results :

      Failed tests: testCurrentTime(jenkins.plugins.testlink.examples.TestCurrentTime): expected:<true> but was:<false>

      Tests run: 1, Failures: 1, Errors: 0, Skipped: 0

      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 53.719s
      [INFO] Finished at: Thu Jun 21 16:31:01 EDT 2012
      [INFO] Final Memory: 124M/247M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.10:test (default-test) on project jenkins-testlink-plugin-tutorial: There are test failures.
      [ERROR]
      [ERROR] Please refer to C:\Jenkin\jobs\testMaven\workspace\target\surefire-reports for the individual test results.
      [ERROR] -> [Help 1]
      [ERROR]
      [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
      [ERROR] Re-run Maven using the -X switch to enable full debug logging.
      [ERROR]
      [ERROR] For more information about the errors and possible solutions, please read the following articles:
      [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
      Build step 'Invoke top-level Maven targets' marked build as failure
      Finished: FAILURE

        Attachments

          Activity

          Hide
          jorgenpt Jørgen Tjernø added a comment -

          The "jenkins-plugin-runtime" component is unrelated to TestLink Plugin - it's a runtime for running Ruby plugins in Jenkins. Removing component and setting assignee to "automatic".

          Show
          jorgenpt Jørgen Tjernø added a comment - The "jenkins-plugin-runtime" component is unrelated to TestLink Plugin - it's a runtime for running Ruby plugins in Jenkins. Removing component and setting assignee to "automatic".
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi Karthik,

          Could you share more about your job configuration, please? Are you using "clean test" as top level maven build step? It would be useful if you could post some pictures of your job and testlink configuration, or detailed configuration

          Thanks
          -B

          Show
          kinow Bruno P. Kinoshita added a comment - Hi Karthik, Could you share more about your job configuration, please? Are you using "clean test" as top level maven build step? It would be useful if you could post some pictures of your job and testlink configuration, or detailed configuration Thanks -B
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi Karthik! Now I've noticed that the build is failing and not the tests. Failed tests don't mark the build as FAILURE (unless you say so, under advanced settings). Try reviewing your settings in your build, and let me know if there is any outdated information in the plug-in tutorial.

          Cheers, B

          Show
          kinow Bruno P. Kinoshita added a comment - Hi Karthik! Now I've noticed that the build is failing and not the tests. Failed tests don't mark the build as FAILURE (unless you say so, under advanced settings). Try reviewing your settings in your build, and let me know if there is any outdated information in the plug-in tutorial. Cheers, B
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Fixed in 3.1.7 (available from update-center in the next hours)

          Show
          kinow Bruno P. Kinoshita added a comment - Fixed in 3.1.7 (available from update-center in the next hours)

            People

            • Assignee:
              kinow Bruno P. Kinoshita
              Reporter:
              thenna Karthik T
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: