Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-22016

TAP test results of matrix configuration project do not show in main project overview and dashboard

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      I use the TAP Plugin to publish test results of a matrix configuration project. To see the results I have to select the project, then a specific build with test results and there I can access the extended TAP information.

      I can access basic test results through the "test results" link beneath the projects configuration matrix. But "TAP Extended Test Results" says "No TAP Results available, yet." This is only available when choosing a specific build.

      What is worse, the dashboard view test statistics do not pick up the test results from the project. The number of tests run is shown correctly in the "Test Trend Chart", but "Test Statistics Chart" and "Test Statictics Grid" do not pick up any results (0 tests / no data available).

      I believe the TAP Plugin does not correctly publish results to the master project but only to the single configurations? A similar issue is reported in JENKINS-12205, although it is about xunit and not TAP.

      Please check the interaction of the TAP Plugin and matrix configuration projects.

        Attachments

          Activity

          Hide
          kinow Bruno P. Kinoshita added a comment -

          Hi Stefan and Peter.

          I'm trying to clean some issues in the TAP Plug-in and cut a new release, then I need to fix memory issues, and then will review this issue. Let me know if you guys find anything in the meantime.

          Thanks
          Bruno

          Show
          kinow Bruno P. Kinoshita added a comment - Hi Stefan and Peter. I'm trying to clean some issues in the TAP Plug-in and cut a new release, then I need to fix memory issues, and then will review this issue. Let me know if you guys find anything in the meantime. Thanks Bruno
          Hide
          vandyev Evan Van Dyke added a comment -

          We are seeing the same thing (TAP plugin version 1.24, Matrix version 1.6). It would be a great help to get this one fixed...

          Show
          vandyev Evan Van Dyke added a comment - We are seeing the same thing (TAP plugin version 1.24, Matrix version 1.6). It would be a great help to get this one fixed...
          Hide
          vandyev Evan Van Dyke added a comment - - edited

          I put in a Pull Request with a fix for this issue... it seems to work both on my test-server at home, and our server with real data at work.

          Bruno has taken a quick look, and said he will be evaluating it for integration into TAP 1.25.

          https://github.com/jenkinsci/tap-plugin/pull/10

          Show
          vandyev Evan Van Dyke added a comment - - edited I put in a Pull Request with a fix for this issue... it seems to work both on my test-server at home, and our server with real data at work. Bruno has taken a quick look, and said he will be evaluating it for integration into TAP 1.25. https://github.com/jenkinsci/tap-plugin/pull/10
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Evan
          Path:
          pom.xml
          src/main/java/org/tap4j/plugin/AbstractTapProjectAction.java
          src/main/java/org/tap4j/plugin/TapProjectAction.java
          http://jenkins-ci.org/commit/tap-plugin/f636de3b72aa41cfe654f659a3088215d4638b1d
          Log:
          JENKINS-22016: Enable test status rollup displays on the Dashboard

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Evan Path: pom.xml src/main/java/org/tap4j/plugin/AbstractTapProjectAction.java src/main/java/org/tap4j/plugin/TapProjectAction.java http://jenkins-ci.org/commit/tap-plugin/f636de3b72aa41cfe654f659a3088215d4638b1d Log: JENKINS-22016 : Enable test status rollup displays on the Dashboard
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Evan
          Path:
          pom.xml
          src/main/java/org/tap4j/plugin/TapProjectAction.java
          http://jenkins-ci.org/commit/tap-plugin/712d3e3fb3d540fec91ca19fdc4fa16c5f5e5650
          Log:
          JENKINS-22016: Create Graph for matrix summary page

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Evan Path: pom.xml src/main/java/org/tap4j/plugin/TapProjectAction.java http://jenkins-ci.org/commit/tap-plugin/712d3e3fb3d540fec91ca19fdc4fa16c5f5e5650 Log: JENKINS-22016 : Create Graph for matrix summary page
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Evan Van Dyke's pull request has been merged. Marking as fixed. Can you confirm, please, Evan? If there's further work before we can mark it as fixed, feel free to re-open the issue. Once a release has been cut I will mark the issue as Resolved.

          Thanks.

          Show
          kinow Bruno P. Kinoshita added a comment - Evan Van Dyke 's pull request has been merged. Marking as fixed. Can you confirm, please, Evan? If there's further work before we can mark it as fixed, feel free to re-open the issue. Once a release has been cut I will mark the issue as Resolved. Thanks.
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Marking as fixed, scheduled for 1.25 release

          Show
          kinow Bruno P. Kinoshita added a comment - Marking as fixed, scheduled for 1.25 release
          Hide
          kinow Bruno P. Kinoshita added a comment -

          Closing off this ticket

          Show
          kinow Bruno P. Kinoshita added a comment - Closing off this ticket

            People

            • Assignee:
              kinow Bruno P. Kinoshita
              Reporter:
              snu Stefan Nuernberger
            • Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: