Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-37739

Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline

    Details

    • Type: Improvement
    • Status: In Progress (View Workflow)
    • Priority: Trivial
    • Resolution: Unresolved
    • Component/s: robot-plugin
    • Labels:
      None
    • Similar Issues:

      Description

      I am building running my robot framework test case parallel in Jenkins pipeline. However the Robot Test Summary generated post build is not correct, it displaying the count/summary of last finished in parallelism, however it should show the count of individual job. It was overwriting the report also earlier but that I saved as different name & it worked fine, but still the Robot Test Summary is problem(please not my both suite below have different number of test cases).

      suite1:{
      try

      { mvn -s /settings.xml install robotframework:run -Dexcludes=inprogress -Dsuites=test1 -DLogFileName=suite1_log.html -DoutputFileName=suite1_output.xml -DreportFileName=suite1_report.html' currentBuild.result = 'SUCCESS' }

      catch(any)

      { currentBuild.result = 'FAILURE' throw any }

      finally

      { step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite1_log.html', outputFileName: 'suite1_output.xml', reportFileName: 'suite1_report.html']) }

      },
      suite2:{
      try

      { mvn -s /settings.xml robotframework:run -Dexcludes=inprogress -Dsuites=test2 -DLogFileName=suite2_log.html -DoutputFileName=suite2_output.xml -DreportFileName=suite2_report.html' currentBuild.result = 'SUCCESS' }

      catch(any)

      { currentBuild.result = 'FAILURE' //sendMail() throw any }

      finally

      { step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports/', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite2_log.html', outputFileName: 'suite2_output.xml', reportFileName: 'suite2_report.html']) }

        Attachments

          Activity

          Hide
          jpiironen jpiironen added a comment -

          Hi,

          We've resumed development of the plugin and currently doing a release for more urgent bugs. This seems like a useful improvement for the next iteration.

          Show
          jpiironen jpiironen added a comment - Hi, We've resumed development of the plugin and currently doing a release for more urgent bugs. This seems like a useful improvement for the next iteration.
          Hide
          beeofdoom Matt Calderaz added a comment -

          Just encountered this issue today in overhauling CI for our RF tests; it's not critical, but a fix would be greatly appreciated.

          Show
          beeofdoom Matt Calderaz added a comment - Just encountered this issue today in overhauling CI for our RF tests; it's not critical, but a fix would be greatly appreciated.
          Hide
          graines Glen Raines added a comment -

          Our team here would also prefer to display separate Robot Test Summaries, so a fix would be really appreciated.

          Show
          graines Glen Raines added a comment - Our team here would also prefer to display separate Robot Test Summaries, so a fix would be really appreciated.
          Hide
          mpenven Mériadec Penven added a comment -

          I'm facing the same issue on my project. I confirm that a fix would be really appreciated 

          Thanks in advance

          Show
          mpenven Mériadec Penven added a comment - I'm facing the same issue on my project. I confirm that a fix would be really appreciated  Thanks in advance
          Hide
          singhshyam shyam singh added a comment -

          We have achieved the same in-house by modifying the same plugin, instead of merging the report, we are showing the merge count and all the report in tabular form,  user can access individual report. Indeed this is very fast, whereas we used to spend lots of time in merging the report . Please refer the attached screen shot.

          Show
          singhshyam shyam singh added a comment - We have achieved the same in-house by modifying the same plugin, instead of merging the report, we are showing the merge count and all the report in tabular form,  user can access individual report. Indeed this is very fast, whereas we used to spend lots of time in merging the report . Please refer the attached screen shot.

            People

            • Assignee:
              hifi Juho Saarinen
              Reporter:
              singhshyam shyam singh
            • Votes:
              8 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated: