Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-58449

Fix reporting of Core/acceptance-test-harness

    Details

    • Similar Issues:

      Description

      Core/acceptance-test-harness builds, when they fail in Docker image creation, print messages like

      [[ATTACHMENT|/mnt/agent-workspace/workspace/eptance-test-harness_PR-375-RULQ756Q5XJYHISNZNLW6EUAWEOJM3D5M7WRUJVERIK42PCAFW4A/target/diagnostics/maven_integration(plugins.ArtifactoryPluginTest)/docker-ArtifactoryContainer.build.log]]
      Standard Error
      

      intended to be interpreted by junit-attachments. Without that attachment, there is no way to see what the failure was. This feature would have to be enabled in acceptance-test-harness/Jenkinsfile, yet this plugin is not installed.

      Also these builds are very slow, so we would like to use the realtimeJUnit step, yet the junit-realtime-test-reporter plugin is also not installed.

      CC Oliver Gondža.

        Attachments

          Activity

          jglick Jesse Glick created issue -
          Hide
          rtyler R. Tyler Croy added a comment -

          I cannot tell whether this ticket is for the JENKINS project because ATH is broken, or whether this is a ticket asking for new plugins to be installed into our environment.

          Show
          rtyler R. Tyler Croy added a comment - I cannot tell whether this ticket is for the JENKINS project because ATH is broken, or whether this is a ticket asking for new plugins to be installed into our environment.
          Hide
          olivergondza Oliver Gondža added a comment -

          Installing both plugins will improve the experience as we can easily link diagnostics with failed tests and observe tests results while in progress.

          Show
          olivergondza Oliver Gondža added a comment - Installing both plugins will improve the experience as we can easily link diagnostics with failed tests and observe tests results while in progress.
          Hide
          jglick Jesse Glick added a comment -

          R. Tyler Croy the first step must be for those two plugins to be installed. Then it would be possible to edit the Jenkinsfile to use them.

          Show
          jglick Jesse Glick added a comment - R. Tyler Croy the first step must be for those two plugins to be installed. Then it would be possible to edit the Jenkinsfile to use them.
          Hide
          jglick Jesse Glick added a comment -

          FTR: DockerRule, used by JenkinsRule clients of docker-fixtures, prints relevant logs to stdout upon test failure. But DockerContainerHolder in acceptance-test-harness assumes that the JUnit Attachments plugin is available.

          Show
          jglick Jesse Glick added a comment - FTR: DockerRule , used by JenkinsRule clients of docker-fixtures , prints relevant logs to stdout upon test failure . But DockerContainerHolder in acceptance-test-harness assumes that the JUnit Attachments plugin is available .
          jglick Jesse Glick made changes -
          Field Original Value New Value
          Remote Link This issue links to "jenkins-infra PR 898 (Web Link)" [ 18029 ]
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Jesse Glick
          Path:
          hieradata/clients/ci.yaml
          http://jenkins-ci.org/commit/jenkins-infra/df6a963c95ca6f21c299e1fcbfcf9bb6d54d97fe
          Log:
          INFRA-1404 Adding junit-attachments & junit-realtime-test-reporter.

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Jesse Glick Path: hieradata/clients/ci.yaml http://jenkins-ci.org/commit/jenkins-infra/df6a963c95ca6f21c299e1fcbfcf9bb6d54d97fe Log: INFRA-1404 Adding junit-attachments & junit-realtime-test-reporter.
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: R. Tyler Croy
          Path:
          hieradata/clients/ci.yaml
          http://jenkins-ci.org/commit/jenkins-infra/9618b5a78165a18a6a759a90b34cfc60dad3bc88
          Log:
          Merge pull request #898 from jglick/INFRA-1404

          INFRA-1404 Adding junit-attachments & junit-realtime-test-reporter

          Compare: https://github.com/jenkins-infra/jenkins-infra/compare/6cbb8a48004b...9618b5a78165

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: R. Tyler Croy Path: hieradata/clients/ci.yaml http://jenkins-ci.org/commit/jenkins-infra/9618b5a78165a18a6a759a90b34cfc60dad3bc88 Log: Merge pull request #898 from jglick/ INFRA-1404 INFRA-1404 Adding junit-attachments & junit-realtime-test-reporter Compare: https://github.com/jenkins-infra/jenkins-infra/compare/6cbb8a48004b...9618b5a78165
          Hide
          jglick Jesse Glick added a comment -

          I will watch https://ci.jenkins.io/pipeline-syntax/ to see when these are available.

          Show
          jglick Jesse Glick added a comment - I will watch https://ci.jenkins.io/pipeline-syntax/  to see when these are available.
          Hide
          jglick Jesse Glick added a comment -

          Looks to be live, will work on using them. Thanks!

          Show
          jglick Jesse Glick added a comment - Looks to be live, will work on using them. Thanks!
          jglick Jesse Glick made changes -
          Remote Link This issue links to "acceptance-test-harness PR 382 (Web Link)" [ 18032 ]
          jglick Jesse Glick made changes -
          Assignee Jesse Glick [ jglick ]
          jglick Jesse Glick made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Jesse Glick
          Path:
          Jenkinsfile
          http://jenkins-ci.org/commit/acceptance-test-harness/28a2eac5fbff2efcb440f5da54346208ec03d9e0
          Log:
          INFRA-1404 Use junit-attachments & junit-realtime-test-reporter plugins.

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Jesse Glick Path: Jenkinsfile http://jenkins-ci.org/commit/acceptance-test-harness/28a2eac5fbff2efcb440f5da54346208ec03d9e0 Log: INFRA-1404 Use junit-attachments & junit-realtime-test-reporter plugins.
          Hide
          scm_issue_link SCM/JIRA link daemon added a comment -

          Code changed in jenkins
          User: Oliver Gondža
          Path:
          Jenkinsfile
          http://jenkins-ci.org/commit/acceptance-test-harness/68b170f3c78d07806296490311279aaf6e7b729f
          Log:
          Merge pull request #382 from jglick/reporting-INFRA-1404

          INFRA-1404 Use junit-attachments & junit-realtime-test-reporter plugins

          Compare: https://github.com/jenkinsci/acceptance-test-harness/compare/225af075971f...68b170f3c78d

          Show
          scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oliver Gondža Path: Jenkinsfile http://jenkins-ci.org/commit/acceptance-test-harness/68b170f3c78d07806296490311279aaf6e7b729f Log: Merge pull request #382 from jglick/reporting- INFRA-1404 INFRA-1404 Use junit-attachments & junit-realtime-test-reporter plugins Compare: https://github.com/jenkinsci/acceptance-test-harness/compare/225af075971f...68b170f3c78d
          Hide
          jglick Jesse Glick added a comment -

          Realtime JUnit results are working. I cannot see evidence of attachments working here; perhaps that plugin does not work in combination with realtime JUnit results (probably never tested). Will have to recheck once there is a completed build with some test failures including attachments.

          Show
          jglick Jesse Glick added a comment - Realtime JUnit results are working. I cannot see evidence of attachments working here ; perhaps that plugin does not work in combination with realtime JUnit results (probably never tested). Will have to recheck once there is a completed build with some test failures including attachments.
          jglick Jesse Glick made changes -
          Project Infrastructure [ 10301 ] Jenkins [ 10172 ]
          Key INFRA-1404 JENKINS-58449
          Workflow classic default workflow [ 223839 ] JNJira + In-Review [ 237983 ]
          Component/s acceptance-test-harness [ 18623 ]
          Component/s ci [ 18920 ]
          Show
          olivergondza Oliver Gondža added a comment - This is working for a while: https://ci.jenkins.io/job/Core/job/acceptance-test-harness/job/master/167/testReport/junit/plugins/DashboardViewPluginTest/java_8_split0___jobsGridPortlet_numberOfColumns/
          olivergondza Oliver Gondža made changes -
          Status In Progress [ 3 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              jglick Jesse Glick
              Reporter:
              jglick Jesse Glick
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: