Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-51942

Improve Kafka producer-consumer topic model

    Details

    • Similar Issues:

      Description

      Re-design topic, groupID model for the current implementation.

        Attachments

          Activity

          pvtuan10 Pham Vu Tuan created issue -
          pvtuan10 Pham Vu Tuan made changes -
          Field Original Value New Value
          Epic Link JENKINS-51943 [ 191430 ]
          pvtuan10 Pham Vu Tuan made changes -
          Priority Major [ 3 ] Minor [ 4 ]
          pvtuan10 Pham Vu Tuan made changes -
          Description We need to:
           * Investigate on consumer pooling, NIO options.
           * Study Kafka to re-design topic, groupID model. For the current model, we need different topics for different master-agent connections, which I am not sure is good enough.
           * Jenkins admin should have opportunities to login to Kafka admin portal to do admin work such as filtering of topics, events, connectivity issues, ...
           * Investigate on tools like [https://github.com/yahoo/kafka-manager] then incorporate into Docker compose.
          pvtuan10 Pham Vu Tuan made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          pvtuan10 Pham Vu Tuan made changes -
          Status In Progress [ 3 ] In Review [ 10005 ]
          pvtuan10 Pham Vu Tuan made changes -
          Description We need to:
           * Investigate on consumer pooling, NIO options.
           * Study Kafka to re-design topic, groupID model. For the current model, we need different topics for different master-agent connections, which I am not sure is good enough.
           * Jenkins admin should have opportunities to login to Kafka admin portal to do admin work such as filtering of topics, events, connectivity issues, ...
           * Investigate on tools like [https://github.com/yahoo/kafka-manager] then incorporate into Docker compose.
          Re-design topic, groupID model for the current implementation.
          pvtuan10 Pham Vu Tuan made changes -
          Summary Improve Kafka producer-consumer model to ensure reliability Improve Kafka producer-consumer topic model
          pvtuan10 Pham Vu Tuan made changes -
          Status In Review [ 10005 ] Resolved [ 5 ]
          Resolution Done [ 10000 ]

            People

            • Assignee:
              pvtuan10 Pham Vu Tuan
              Reporter:
              pvtuan10 Pham Vu Tuan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: