Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-8460

xUnit does not parse nested <testsuite>-tags from PHPUnit

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Component/s: xunit-plugin
    • Labels:
      None
    • Environment:
      Debian Lenny, PHP 5.3.5-0.dotdeb., PHPUnit 3.5.7
    • Similar Issues:

      Description

      xUnit does not read the following output with nested <testsuite>-tags from PHPUnit:

      <testsuites>
      <testsuite name="src/webroot/trackstar/protected/tests/unit" tests="1" assertions="2" failures="0" errors="0" time="0.032417">
      <testsuite name="DbTest" file="src/protected/tests/unit/DbTest.php" tests="1" assertions="2" failures="0" errors="0" time="0.032417">
      <testcase name="testConnection" class="DbTest" file="src/protected/tests/unit/DbTest.php" line="4" assertions="2" time="0.032417"/>
      </testsuite>
      </testsuite>
      </testsuites>

      The version without nested tags works:

      <testsuites>
      <testsuite name="DbTest" file="src/protected/tests/unit/DbTest.php" tests="1" assertions="2" failures="0" errors="0" time="0.032417">
      <testcase name="testConnection" class="DbTest" file="src/protected/tests/unit/DbTest.php" line="4" assertions="2" time="0.032417"/>
      </testsuite>
      </testsuites>

      I think it would be nice, if xUnit supports nested <testsuite>-tags. The workaround with a xlst is somehow cumbersome.

        Attachments

          Activity

          Hide
          gbois Gregory Boissinot added a comment -

          Ok, I reoponed the issue.
          Please attach your test result file. I'll try to reproduce it in my context.

          Show
          gbois Gregory Boissinot added a comment - Ok, I reoponed the issue. Please attach your test result file. I'll try to reproduce it in my context.
          Hide
          tyrael Ferenc Kovacs added a comment -

          hm.
          now I'm getting "for the metric 'JUnit' is not valid. The result file has been skipped." for each of my sample junit.xml.
          could you give me a junit file which works for you?
          (of course all of my sample and "production" files are working with the built-in junit plugin just fine)
          I tried to test it with the latest release (non-lts) on a vanila ubuntu vm: same problem.

          Show
          tyrael Ferenc Kovacs added a comment - hm. now I'm getting "for the metric 'JUnit' is not valid. The result file has been skipped." for each of my sample junit.xml. could you give me a junit file which works for you? (of course all of my sample and "production" files are working with the built-in junit plugin just fine) I tried to test it with the latest release (non-lts) on a vanila ubuntu vm: same problem.
          Hide
          gbois Gregory Boissinot added a comment -

          All is OK with version 1.46

          Show
          gbois Gregory Boissinot added a comment - All is OK with version 1.46
          Hide
          jyang Jason Yang added a comment - - edited

          Nested testsuites are still not working for me.

          Versions:

          PHP 5.3.3
          PHPUnit 3.7.29
          Jenkins ver. 1.532.3
          xUnit plugin 1.88 (also tested with 1.84)

          Command I ran to generate the xml:

          phpunit --log-junit=junit.xml --bootstrap=bootstrap.php ShopperSuites ShopperSuites.class.php
          

          junit.xml (edit 2014-05-05 15:31 GMT-5... I pasted the wrong content):

          <?xml version="1.0" encoding="UTF-8"?>
          <testsuites>
            <testsuite name="Shopper">
              <testsuite name="UserAccount">
                <testsuite name="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" tests="20" assertions="95" failures="5" errors="0" time="2.476262">
                  <testcase name="testConvertGuest" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="70" assertions="3" time="1.384121">
                    <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testConvertGuest
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:117
          </failure>
                  </testcase>
                  <testcase name="testPasswordPolicy" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="143" assertions="4" time="0.300475">
                    <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testPasswordPolicy
          Failed asserting that 'Username already in use' contains "PasswordPolicy:".
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:180
          </failure>
                  </testcase>
                  <testcase name="testCreateVerifyUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="267" assertions="1" time="0.077179">
                    <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateVerifyUser
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:284
          </failure>
                  </testcase>
                  <testcase name="testCreateUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="296" assertions="1" time="0.142059">
                    <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateUser
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:320
          </failure>
                  </testcase>
                  <testcase name="testCreateEmailUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="352" assertions="1" time="0.075566">
                    <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateEmailUser
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:371
          </failure>
                  </testcase>
                  <testcase name="testMissingUsername" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="451" assertions="15" time="0.078031"/>
                  <testsuite name="UserAccountCreateTest::testBadEmail" tests="14" assertions="70" failures="0" errors="0" time="0.418831">
                    <testcase name="testBadEmail with data set #0" assertions="5" time="0.030672"/>
                    <testcase name="testBadEmail with data set #1" assertions="5" time="0.030511"/>
                    <testcase name="testBadEmail with data set #2" assertions="5" time="0.030498"/>
                    <testcase name="testBadEmail with data set #3" assertions="5" time="0.030270"/>
                    <testcase name="testBadEmail with data set #4" assertions="5" time="0.029271"/>
                    <testcase name="testBadEmail with data set #5" assertions="5" time="0.031228"/>
                    <testcase name="testBadEmail with data set #6" assertions="5" time="0.029011"/>
                    <testcase name="testBadEmail with data set #7" assertions="5" time="0.029860"/>
                    <testcase name="testBadEmail with data set #8" assertions="5" time="0.029886"/>
                    <testcase name="testBadEmail with data set #9" assertions="5" time="0.029726"/>
                    <testcase name="testBadEmail with data set #10" assertions="5" time="0.029914"/>
                    <testcase name="testBadEmail with data set #11" assertions="5" time="0.029822"/>
                    <testcase name="testBadEmail with data set #12" assertions="5" time="0.028398"/>
                    <testcase name="testBadEmail with data set #13" assertions="5" time="0.029764"/>
                  </testsuite>
                </testsuite>
                <testsuite name="UserAccountUpdateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountUpdateTest.php">
                  <testsuite name="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" tests="7" assertions="14" failures="4" errors="0" time="0.187253">
                    <testcase name="testDisabledKeyEnforcement" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="76" assertions="3" time="0.044701"/>
                    <testcase name="testEnableKeyEnforcement" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="93" assertions="1" time="0.004085"/>
                    <testcase name="testGetSpecificKeys" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="116" assertions="1" time="0.028130">
                      <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetSpecificKeys
          array (
            'success' =&gt; 0,
            'error' =&gt;
            array (
              'status' =&gt; 400,
              'message' =&gt; 'Invalid user authentication token',
              'code' =&gt; 125,
            ),
          )
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:127
          </failure>
                    </testcase>
                    <testcase name="testGetAllKeys" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="140" assertions="1" time="0.027625">
                      <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetAllKeys
          array (
            'success' =&gt; 0,
            'error' =&gt;
            array (
              'status' =&gt; 400,
              'message' =&gt; 'Invalid user authentication token',
              'code' =&gt; 125,
            ),
          )
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:149
          </failure>
                    </testcase>
                    <testcase name="testGetAllKeysAndVals" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="159" assertions="1" time="0.027671">
                      <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetAllKeysAndVals
          array (
            'success' =&gt; 0,
            'error' =&gt;
            array (
              'status' =&gt; 400,
              'message' =&gt; 'Invalid user authentication token',
              'code' =&gt; 125,
            ),
          )
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:168
          </failure>
                    </testcase>
                    <testcase name="testGetBadKey" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="181" assertions="1" time="0.027140">
                      <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetBadKey
          array (
            'success' =&gt; 0,
            'error' =&gt;
            array (
              'status' =&gt; 400,
              'message' =&gt; 'Invalid user authentication token',
              'code' =&gt; 125,
            ),
          )
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:190
          </failure>
                    </testcase>
                    <testcase name="testNoAuth" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="199" assertions="6" time="0.027901"/>
                  </testsuite>
                  <testsuite name="UserAccountGetInfoTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetInfoTest.php">
                    <testsuite name="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" tests="2" assertions="7" failures="1" errors="0" time="0.434098">
                      <testcase name="testValidParameters" class="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" line="95" assertions="2" time="0.388051">
                        <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountForgotPasswordTest::testValidParameters
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php:130
          </failure>
                      </testcase>
                      <testcase name="testMissingEmail" class="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" line="183" assertions="5" time="0.046047"/>
                    </testsuite>
                    <testsuite name="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" tests="3" assertions="9" failures="1" errors="0" time="0.199766">
                      <testcase name="testValidParameters" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="73" assertions="1" time="0.141116">
                        <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountVerifyResetTokenTest::testValidParameters
          stdClass::__set_state(array(
             'success' =&gt; 0,
             'error' =&gt;
            stdClass::__set_state(array(
               'status' =&gt; 400,
               'message' =&gt; 'Required parameter is missing',
               'code' =&gt; 105,
            )),
          ))
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php:81
          </failure>
                      </testcase>
                      <testcase name="testInvalidToken" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="89" assertions="3" time="0.031005"/>
                      <testcase name="testMissingToken" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="106" assertions="5" time="0.027645"/>
                    </testsuite>
                    <testsuite name="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" tests="5" assertions="23" failures="3" errors="0" time="0.768398">
                      <testcase name="testPasswordPolicy" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="85" assertions="3" time="0.262486">
                        <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testPasswordPolicy
          Failed asserting that 403 matches expected '400'.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:127
          </failure>
                      </testcase>
                      <testcase name="testInvalidToken" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="168" assertions="5" time="0.133414"/>
                      <testcase name="testMissingParameters" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="192" assertions="10" time="0.121423"/>
                      <testcase name="testSamePassword" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="232" assertions="4" time="0.108570">
                        <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testSamePassword
          Failed asserting that two strings are equal.
          --- Expected
          +++ Actual
          @@ @@
          -'Cannot use same password twice'
          +'Required parameter is missing'
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:249
          </failure>
                      </testcase>
                      <testcase name="testValidParameters" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="257" assertions="1" time="0.142505">
                        <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testValidParameters
          stdClass::__set_state(array(
             'success' =&gt; 0,
             'error' =&gt;
            stdClass::__set_state(array(
               'status' =&gt; 400,
               'message' =&gt; 'Required parameter is missing',
               'code' =&gt; 105,
            )),
          ))
          Failed asserting that false is true.
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:270
          </failure>
                      </testcase>
                    </testsuite>
                    <testsuite name="UserAccountSignTosTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountSignTosTest.php">
                      <testsuite name="UserAccountGetTosTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetTosTest.php">
                        <testsuite name="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" tests="4" assertions="14" failures="0" errors="0" time="0.192645">
                          <testcase name="testEmailInOrganization" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="58" assertions="2" time="0.035739"/>
                          <testcase name="testNonExistentEmail" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="74" assertions="2" time="0.094768"/>
                          <testcase name="testMissingParameters" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="110" assertions="5" time="0.026124"/>
                          <testcase name="testInvalidEmail" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="130" assertions="5" time="0.036014"/>
                        </testsuite>
                        <testsuite name="UserAccountAddIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountAddIdentityTest.class.php">
                          <testsuite name="UserAccountDeleteIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountDeleteIdentityTest.class.php">
                            <testsuite name="UserAccountGetIdentitiesTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetIdentitiesTest.class.php">
                              <testsuite name="UserAccountPromoteIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountPromoteIdentityTest.class.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808">
                                <testsuite name="UserAccountUpdatePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountUpdatePasswordTest.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808">
                                  <testsuite name="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808">
                                    <testcase name="testGoodAddThenRemove" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="62" assertions="0" time="1.085274">
                                      <error type="Exception">UserAccountBlacklistHandlerTest::testGoodAddThenRemove
          Exception: Authentication Failed
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43
          </error>
                                    </testcase>
                                    <testcase name="testRemoveThenAdd" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="90" assertions="0" time="1.125185">
                                      <error type="Exception">UserAccountBlacklistHandlerTest::testRemoveThenAdd
          Exception: Authentication Failed
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43
          </error>
                                    </testcase>
                                    <testcase name="testCaseInsensitivity" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="127" assertions="0" time="1.124349">
                                      <error type="Exception">UserAccountBlacklistHandlerTest::testCaseInsensitivity
          Exception: Authentication Failed
          
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314
          /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43
          </error>
                                    </testcase>
                                  </testsuite>
                                </testsuite>
                              </testsuite>
                            </testsuite>
                          </testsuite>
                        </testsuite>
                      </testsuite>
                    </testsuite>
                  </testsuite>
                </testsuite>
              </testsuite>
            </testsuite>
          </testsuites>
          
          Show
          jyang Jason Yang added a comment - - edited Nested testsuites are still not working for me. Versions : PHP 5.3.3 PHPUnit 3.7.29 Jenkins ver. 1.532.3 xUnit plugin 1.88 (also tested with 1.84) Command I ran to generate the xml : phpunit --log-junit=junit.xml --bootstrap=bootstrap.php ShopperSuites ShopperSuites.class.php junit.xml (edit 2014-05-05 15:31 GMT-5... I pasted the wrong content): <?xml version="1.0" encoding="UTF-8"?> <testsuites> <testsuite name="Shopper"> <testsuite name="UserAccount"> <testsuite name="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" tests="20" assertions="95" failures="5" errors="0" time="2.476262"> <testcase name="testConvertGuest" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="70" assertions="3" time="1.384121"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testConvertGuest Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:117 </failure> </testcase> <testcase name="testPasswordPolicy" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="143" assertions="4" time="0.300475"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testPasswordPolicy Failed asserting that 'Username already in use' contains "PasswordPolicy:". /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:180 </failure> </testcase> <testcase name="testCreateVerifyUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="267" assertions="1" time="0.077179"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateVerifyUser Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:284 </failure> </testcase> <testcase name="testCreateUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="296" assertions="1" time="0.142059"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateUser Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:320 </failure> </testcase> <testcase name="testCreateEmailUser" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="352" assertions="1" time="0.075566"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountCreateTest::testCreateEmailUser Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php:371 </failure> </testcase> <testcase name="testMissingUsername" class="UserAccountCreateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCreateTest.php" line="451" assertions="15" time="0.078031"/> <testsuite name="UserAccountCreateTest::testBadEmail" tests="14" assertions="70" failures="0" errors="0" time="0.418831"> <testcase name="testBadEmail with data set #0" assertions="5" time="0.030672"/> <testcase name="testBadEmail with data set #1" assertions="5" time="0.030511"/> <testcase name="testBadEmail with data set #2" assertions="5" time="0.030498"/> <testcase name="testBadEmail with data set #3" assertions="5" time="0.030270"/> <testcase name="testBadEmail with data set #4" assertions="5" time="0.029271"/> <testcase name="testBadEmail with data set #5" assertions="5" time="0.031228"/> <testcase name="testBadEmail with data set #6" assertions="5" time="0.029011"/> <testcase name="testBadEmail with data set #7" assertions="5" time="0.029860"/> <testcase name="testBadEmail with data set #8" assertions="5" time="0.029886"/> <testcase name="testBadEmail with data set #9" assertions="5" time="0.029726"/> <testcase name="testBadEmail with data set #10" assertions="5" time="0.029914"/> <testcase name="testBadEmail with data set #11" assertions="5" time="0.029822"/> <testcase name="testBadEmail with data set #12" assertions="5" time="0.028398"/> <testcase name="testBadEmail with data set #13" assertions="5" time="0.029764"/> </testsuite> </testsuite> <testsuite name="UserAccountUpdateTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountUpdateTest.php"> <testsuite name="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" tests="7" assertions="14" failures="4" errors="0" time="0.187253"> <testcase name="testDisabledKeyEnforcement" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="76" assertions="3" time="0.044701"/> <testcase name="testEnableKeyEnforcement" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="93" assertions="1" time="0.004085"/> <testcase name="testGetSpecificKeys" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="116" assertions="1" time="0.028130"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetSpecificKeys array ( 'success' =&gt; 0, 'error' =&gt; array ( 'status' =&gt; 400, 'message' =&gt; 'Invalid user authentication token', 'code' =&gt; 125, ), ) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:127 </failure> </testcase> <testcase name="testGetAllKeys" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="140" assertions="1" time="0.027625"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetAllKeys array ( 'success' =&gt; 0, 'error' =&gt; array ( 'status' =&gt; 400, 'message' =&gt; 'Invalid user authentication token', 'code' =&gt; 125, ), ) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:149 </failure> </testcase> <testcase name="testGetAllKeysAndVals" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="159" assertions="1" time="0.027671"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetAllKeysAndVals array ( 'success' =&gt; 0, 'error' =&gt; array ( 'status' =&gt; 400, 'message' =&gt; 'Invalid user authentication token', 'code' =&gt; 125, ), ) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:168 </failure> </testcase> <testcase name="testGetBadKey" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="181" assertions="1" time="0.027140"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountGetAuxTest::testGetBadKey array ( 'success' =&gt; 0, 'error' =&gt; array ( 'status' =&gt; 400, 'message' =&gt; 'Invalid user authentication token', 'code' =&gt; 125, ), ) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php:190 </failure> </testcase> <testcase name="testNoAuth" class="UserAccountGetAuxTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetAuxTest.php" line="199" assertions="6" time="0.027901"/> </testsuite> <testsuite name="UserAccountGetInfoTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetInfoTest.php"> <testsuite name="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" tests="2" assertions="7" failures="1" errors="0" time="0.434098"> <testcase name="testValidParameters" class="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" line="95" assertions="2" time="0.388051"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountForgotPasswordTest::testValidParameters Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php:130 </failure> </testcase> <testcase name="testMissingEmail" class="UserAccountForgotPasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountForgotPasswordTest.php" line="183" assertions="5" time="0.046047"/> </testsuite> <testsuite name="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" tests="3" assertions="9" failures="1" errors="0" time="0.199766"> <testcase name="testValidParameters" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="73" assertions="1" time="0.141116"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountVerifyResetTokenTest::testValidParameters stdClass::__set_state(array( 'success' =&gt; 0, 'error' =&gt; stdClass::__set_state(array( 'status' =&gt; 400, 'message' =&gt; 'Required parameter is missing', 'code' =&gt; 105, )), )) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php:81 </failure> </testcase> <testcase name="testInvalidToken" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="89" assertions="3" time="0.031005"/> <testcase name="testMissingToken" class="UserAccountVerifyResetTokenTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountVerifyResetTokenTest.php" line="106" assertions="5" time="0.027645"/> </testsuite> <testsuite name="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" tests="5" assertions="23" failures="3" errors="0" time="0.768398"> <testcase name="testPasswordPolicy" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="85" assertions="3" time="0.262486"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testPasswordPolicy Failed asserting that 403 matches expected '400'. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:127 </failure> </testcase> <testcase name="testInvalidToken" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="168" assertions="5" time="0.133414"/> <testcase name="testMissingParameters" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="192" assertions="10" time="0.121423"/> <testcase name="testSamePassword" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="232" assertions="4" time="0.108570"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testSamePassword Failed asserting that two strings are equal. --- Expected +++ Actual @@ @@ -'Cannot use same password twice' +'Required parameter is missing' /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:249 </failure> </testcase> <testcase name="testValidParameters" class="UserAccountChangePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php" line="257" assertions="1" time="0.142505"> <failure type="PHPUnit_Framework_ExpectationFailedException">UserAccountChangePasswordTest::testValidParameters stdClass::__set_state(array( 'success' =&gt; 0, 'error' =&gt; stdClass::__set_state(array( 'status' =&gt; 400, 'message' =&gt; 'Required parameter is missing', 'code' =&gt; 105, )), )) Failed asserting that false is true. /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountChangePasswordTest.php:270 </failure> </testcase> </testsuite> <testsuite name="UserAccountSignTosTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountSignTosTest.php"> <testsuite name="UserAccountGetTosTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetTosTest.php"> <testsuite name="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" tests="4" assertions="14" failures="0" errors="0" time="0.192645"> <testcase name="testEmailInOrganization" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="58" assertions="2" time="0.035739"/> <testcase name="testNonExistentEmail" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="74" assertions="2" time="0.094768"/> <testcase name="testMissingParameters" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="110" assertions="5" time="0.026124"/> <testcase name="testInvalidEmail" class="UserAccountCheckEmailTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountCheckEmailTest.php" line="130" assertions="5" time="0.036014"/> </testsuite> <testsuite name="UserAccountAddIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountAddIdentityTest.class.php"> <testsuite name="UserAccountDeleteIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountDeleteIdentityTest.class.php"> <testsuite name="UserAccountGetIdentitiesTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountGetIdentitiesTest.class.php"> <testsuite name="UserAccountPromoteIdentityTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountPromoteIdentityTest.class.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808"> <testsuite name="UserAccountUpdatePasswordTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountUpdatePasswordTest.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808"> <testsuite name="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" tests="3" assertions="0" failures="0" errors="3" time="3.334808"> <testcase name="testGoodAddThenRemove" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="62" assertions="0" time="1.085274"> <error type="Exception">UserAccountBlacklistHandlerTest::testGoodAddThenRemove Exception: Authentication Failed /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314 /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43 </error> </testcase> <testcase name="testRemoveThenAdd" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="90" assertions="0" time="1.125185"> <error type="Exception">UserAccountBlacklistHandlerTest::testRemoveThenAdd Exception: Authentication Failed /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314 /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43 </error> </testcase> <testcase name="testCaseInsensitivity" class="UserAccountBlacklistHandlerTest" file="/var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php" line="127" assertions="0" time="1.124349"> <error type="Exception">UserAccountBlacklistHandlerTest::testCaseInsensitivity Exception: Authentication Failed /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/TestUtil.class.php:314 /var/lib/jenkins/jobs/API_Branches_Template/workspace/test/unit/shopper/userAccount/UserAccountBlacklistHandlerTest.class.php:43 </error> </testcase> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuite> </testsuites>
          Hide
          jyang Jason Yang added a comment -

          Please close issue again, as I found the reason is not related to xUnit or Jenkins.

          PHPUnit seems to have a bug when generating junit logs, I have logged the bug here: https://github.com/sebastianbergmann/phpunit/issues/1250

          Show
          jyang Jason Yang added a comment - Please close issue again, as I found the reason is not related to xUnit or Jenkins. PHPUnit seems to have a bug when generating junit logs, I have logged the bug here: https://github.com/sebastianbergmann/phpunit/issues/1250

            People

            • Assignee:
              gbois Gregory Boissinot
              Reporter:
              dito_ch dito_ch
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: