Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-57870

Request too large for server memory since 10.1.0

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Blocker
    • Resolution: Fixed
    • Component/s: p4-plugin
    • Labels:
    • Environment:
      Jenkins ver. 2.164.3
      p4-plugin : 1.10.0
    • Similar Issues:

      Description

      Hi,

       

      When I use jenkins with swarm automated test,

      I use the pipeline code like

      checkout perforce(
         populate: previewOnly(quiet: true)
         workspace: templateSpec( ... )
      )
      

      and template workspace have all depot like

      //depotA/... //$P4_CLIENT/depotA/...
      //depotB/... //$P4_CLIENT/depotB/...
      //depotC/... //$P4_CLIENT/depotC/...
      ...
      

      and I create new workspace and delete after finished job always.

       

      as you know, because I want to do like

      unshelve files in the review item and run some test.

      I don't need sync, sync -n or sync -k and flush, delete, whatever..

       

      here's error message.

      [Pipeline] container[Pipeline] {[Pipeline] checkout*
      02:02:57* (p4):cmd:... p4 client -o TEMPLATE_SE_SWARM_AT_SA*
      02:02:57* p4 client -o TEMPLATESE_SWARM_AT_SA*
      02:02:57* 
      02:02:57 (p4):stop:3*
      02:02:57* (p4):cmd:... p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:57* p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:57* 
      02:02:58 (p4):stop:4*
      02:02:58* (p4):cmd:... p4 client -i*
      02:02:58* p4 client -i*
      02:02:58* 
      02:02:58 Client jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z saved.
      02:02:58 
      02:02:58 (p4):stop:5*
      02:02:58* (p4):cmd:... p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:58* p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:58* 
      02:02:58 (p4):stop:6*
      02:02:58* (p4):cmd:... p4 client -i*
      02:02:58* p4 client -i*
      02:02:58* 
      02:02:58 Client jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z saved.
      02:02:58 
      02:02:58 (p4):stop:7*
      02:02:58* (p4):cmd:... p4 client -f -s -t TEMPLATESE_SWARM_AT_SA jenkins-SE-SWARM_AT_SA-21-se-swarm-at-s_
      02:02:58 p4 client -f -s -t TEMPLATESE_SWARM_AT_SA jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:58* 
      02:02:58 Client jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z switched.
      02:02:58 
      02:02:58 (p4):stop:8*
      02:02:58* (p4):cmd:... p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:58* p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:58* 
      02:02:59 (p4):stop:9*
      02:02:59* (p4):cmd:... p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:59* p4 client -o jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z*
      02:02:59* 
      02:02:59 (p4):stop:10*
      02:02:59* (p4):cmd:... p4 counter change*
      02:02:59* p4 counter change*
      02:02:59* 
      02:02:59 (p4):stop:11*
      02:02:59* (p4):cmd:... p4 changes -m1 -ssubmitted //jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z/._
      02:02:59 p4 changes -m1 -ssubmitted //jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z/...
      02:02:59 
      02:02:59 Change 2688516 on 2019/06/05 by sj8282.park@sj8282.park_NOVUS_TASK_SVR19A_mare03 'Add Test Case Template with reg'
      02:02:59 (p4):stop:12*
      02:02:59* (p4):cmd:... p4 counter change*
      02:02:59* p4 counter change*
      02:02:59* 
      02:02:59 (p4):stop:13*
      02:02:59* (p4):cmd:... p4 changes -m1 -ssubmitted //jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z/.__
      02:02:59 p4 changes -m1 -ssubmitted //jenkins-SE-SWARM_AT_SA-21-se-swarm-at-sa-sv1sw-klt6z/...@2688516*
      02:02:59* 
      02:05:28 Operation 'user-changes' failed.
      02:05:28 Request too large for server memory (try later?).
      02:05:28 
      02:05:28 (p4):stop:14
      

       

      I need the option that create workspace without any changes, counter, ... other commands.

      And by the way, this preview option is really needed?

      who want to use p4 sync -nq , it's useless.

      and p4 sync -n command also. I don't know when and why use this option.

        Attachments

          Issue Links

            Activity

            Hide
            p4karl Karl Wirth added a comment -

            Mateusz Delikat - I have been working with this with Paul and it looks like Jenkins is going through an unexpected path to trigger the command (we provide hooks and jenkins chooses which one's to call).

            We are still looking into this but it may be that we don't have enough contextually information when Jenkins calls the second instance to decide if the command needs to be run or not.

            Show
            p4karl Karl Wirth added a comment - Mateusz Delikat - I have been working with this with Paul and it looks like Jenkins is going through an unexpected path to trigger the command (we provide hooks and jenkins chooses which one's to call). We are still looking into this but it may be that we don't have enough contextually information when Jenkins calls the second instance to decide if the command needs to be run or not.
            Hide
            p4paul Paul Allen added a comment -

            For reference: The code to query the change was added to deal with issue JENKINS-57534

            https://github.com/jenkinsci/p4-plugin/commit/c1ed873be0d988d12619b1072bb41a0580aa3bd2

            Show
            p4paul Paul Allen added a comment - For reference: The code to query the change was added to deal with issue JENKINS-57534 https://github.com/jenkinsci/p4-plugin/commit/c1ed873be0d988d12619b1072bb41a0580aa3bd2
            Hide
            p4karl Karl Wirth added a comment -

            Have released a test patch version to fix the "Request too large for memory" problem. Instead of running 'p4 changes -m1' it now runs for the last N changes:
              
                p4 changes m1 -ssubmitted //jenkins-masterJENKINS-57870-changes-m1-0/...@27+23784,273+3784

            N is a configurable variable that can be set under:

              Jenkins > Manage Jenkins > Configure System >  Head change query limit

             

            The test patch can be downloaded from: https://ci.jenkins.io/job/Plugins/job/p4-plugin/job/master/

            Show
            p4karl Karl Wirth added a comment - Have released a test patch version to fix the "Request too large for memory" problem. Instead of running 'p4 changes -m1' it now runs for the last N changes:        p4 changes m1 -ssubmitted //jenkins-master JENKINS-57870 -changes-m1-0/...@27+ 2 3784,27 3 +3784 N is a configurable variable that can be set under:   Jenkins > Manage Jenkins > Configure System >  Head change query limit   The test patch can be downloaded from: https://ci.jenkins.io/job/Plugins/job/p4-plugin/job/master/
            Hide
            p4karl Karl Wirth added a comment -

            Test patch released.

            Show
            p4karl Karl Wirth added a comment - Test patch released.
            Hide
            p4paul Paul Allen added a comment -

            Released in 1.10.3

            Show
            p4paul Paul Allen added a comment - Released in 1.10.3

              People

              • Assignee:
                Unassigned
                Reporter:
                luckyhorang Hokwang Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: