Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-38314

External Build Log storage for Jenkins. Prototype #1

    Details

    • Epic Name:
      External Build Log storage for Jenkins. Prototype #1
    • Similar Issues:

      Description

      We would like to have a prototype of Build External Logging system.

      Concept:

      • External Storage: Elasticsearch-Logstash-Kibana stack
      • Jenkins agents report their log events directly to system without passing master
      • Do not store logs on a system disk
      • Users are able to see build logs from Jenkins web UI
      • Nice2Have: visualization does not require much resources from Jenkins (e.g. client-side implementation with a simple routing of requests for security purposes)

        Attachments

          Issue Links

            Activity

            Hide
            jglick Jesse Glick added a comment -

            FTR seems to consist of core plus workflow-job plus logstash.

            Show
            jglick Jesse Glick added a comment - FTR seems to consist of core plus workflow-job plus logstash .
            Hide
            oleg_nenashev Oleg Nenashev added a comment -

            Jesse Glick exactly. The top-level description of the prototype is here: https://speakerdeck.com/onenashev/jw2016-hackathon-external-build-logging-prototype-demo . Maybe next versions will get another structure since I may need additional API plugins for LogBrowsers/Storages, etc.

            Show
            oleg_nenashev Oleg Nenashev added a comment - Jesse Glick exactly. The top-level description of the prototype is here: https://speakerdeck.com/onenashev/jw2016-hackathon-external-build-logging-prototype-demo . Maybe next versions will get another structure since I may need additional API plugins for LogBrowsers/Storages, etc.
            Hide
            oleg_nenashev Oleg Nenashev added a comment -

            The design is in progress

            Show
            oleg_nenashev Oleg Nenashev added a comment - The design is in progress
            Hide
            oleg_nenashev Oleg Nenashev added a comment -

            I think the first prototyping phase is done. If somebody have time and interest to proceed, see the linked issues

            Show
            oleg_nenashev Oleg Nenashev added a comment - I think the first prototyping phase is done. If somebody have time and interest to proceed, see the linked issues

              People

              • Assignee:
                oleg_nenashev Oleg Nenashev
                Reporter:
                oleg_nenashev Oleg Nenashev
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: