Uploaded image for project: 'Infrastructure'
  1. Infrastructure
  2. INFRA-1782

Move pluginsite monitoring check to a custom docker image

    Details

    • Similar Issues:

      Description

      We currently have a datadog check deployed by puppet to monitor plugins.jenkins.io api age
      A good improvement would be to build a docker image that contains custom check and then deploy it on Kubernetes.
      I suggest the following path
      1. Create a new github repository called 'datadog-checks'
      2. Create a custom docker image based on https://hub.docker.com/r/datadog/agent/ with at least pluginsite check
      3. Publish the custom datadog image
      4. Deploy on Kubernetes

        Attachments

          Activity

          Hide
          mpapo Michael Pailloncy added a comment -

          Repository initialied here: https://github.com/mpailloncy/datadog-checks

          Tested on jenkins-staging DD sub-org, seems to work correctly.

          Show
          mpapo Michael Pailloncy added a comment - Repository initialied here: https://github.com/mpailloncy/datadog-checks Tested on jenkins-staging DD sub-org, seems to work correctly.
          Hide
          mpapo Michael Pailloncy added a comment -

          Since there are already DataDog agents deployed on all hosts, not sure that's a good idea to deploy another agent to perform this kind of checks as it's not recommended by DataDog support to deploy multiple agents on the same host.

          We could dynamically enable this check based on label of deployed containers by using DataDog autodiscovery feature.

          WDYT Olivier Vernin R. Tyler Croy ? 

          Show
          mpapo Michael Pailloncy added a comment - Since there are already DataDog agents deployed on all hosts, not sure that's a good idea to deploy another agent to perform this kind of checks as it's not recommended by DataDog support to deploy multiple agents on the same host. We could dynamically enable this check based on label of deployed containers by using DataDog autodiscovery feature. WDYT Olivier Vernin R. Tyler Croy  ? 
          Hide
          olblak Olivier Vernin added a comment -

          As we deploy datadog on a kubernetes cluster, it could be better to define the checks from helm as explained here

          Show
          olblak Olivier Vernin added a comment - As we deploy datadog on a kubernetes cluster, it could be better to define the checks from helm as explained here
          Hide
          mpapo Michael Pailloncy added a comment -

          Yeah, in my previous comment I was thinking about using k8s annotations: instead of defining checks at the agent level, we can configure autodiscovered checks through k8s annotations directly inside the pluginsite k8s config files. See this example.

          IMO, the main advantage of specifying checks this way is to keep service config files and associated checks close to each other. But it's just a matter of maintenance easiness/preference.

           

          Show
          mpapo Michael Pailloncy added a comment - Yeah, in my previous comment I was thinking about using k8s annotations: instead of defining checks at the agent level, we can configure autodiscovered checks through k8s annotations directly inside the pluginsite k8s config files. See this example . IMO, the main advantage of specifying checks this way is to keep service config files and associated checks close to each other. But it's just a matter of maintenance easiness/preference.  

            People

            • Assignee:
              mpapo Michael Pailloncy
              Reporter:
              olblak Olivier Vernin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: