providers

README

package providers

Providers implement the ConfigProvider interface and are responsible for scanning different sources like files on disk, environment variables, databases or containers and objects metadata, searching for integration configurations. Every configuration, regardless of the format, must specify at least one check instance. Providers dump every configuration they find into a CheckConfig struct containing an array of configuration instances. Configuration instances are converted in YAML format so that a check object will be eventually able to convert them into the appropriate data structure.

Usage example:

var configs []loader.CheckConfig
for _, provider := range configProviders {
  c, _ := provider.Collect()
  configs = append(configs, c...)
}

Config Providers

FileConfigProvider

The FileConfigProvider is a static config provider, it scans the check configs directory once at startup.

KubeletConfigProvider

The KubeletConfigProvider relies on the Kubelet API to detect check configs defined on pod annotations.

DockerConfigProvider

The DockerConfigProvider relies on the Docker API to detect check configs defined on container labels.

ECSConfigProvider

The ECSConfigProvider relies on the ECS API to detect check configs defined on container labels. This config provider is enabled on ECS Fargate only, on ECS EC2 we use the docker config provider.

KubeServiceConfigProvider

The KubeServiceConfigProvider relies on the Kubernetes API server to detect the cluster check configs defined on service annotations. The Datadog Cluster Agent runs this ConfigProvider.

ClusterChecksConfigProvider

The ClusterChecksConfigProvider queries the Datadog Cluster Agent API to consume the exposed cluster check configs. The node Agent or the cluster check runner can run this config provider.

KubeEndpointsConfigProvider

The KubeEndpointsConfigProvider relies on the Kubernetes API server to detect the endpoints check configs defined on service annotations. The Datadog Cluster Agent runs this ConfigProvider.

EndpointChecksConfigProvider

The EndpointChecksConfigProvider queries the Datadog Cluster Agent API to consume the exposed endpoints check configs.

PrometheusPodsConfigProvider

The PrometheusPodsConfigProvider relies on the Kubelet API to detect Prometheus pod annotations and generate a corresponding Openmetrics config.

PrometheusServicesConfigProvider

The PrometheusServicesConfigProvider relies on the Kubernetes API server to watch Prometheus service annotations and generate a corresponding Openmetrics config. The Datadog Cluster Agent runs this ConfigProvider.

CloudFoundryConfigProvider

The CloudFoundryConfigProvider relies on the CloudFoundry BBS API to detect check configs defined in LRP environment variables.

ConsulConfigProvider

The ConsulConfigProvider reads the check configs from consul.

ETCDConfigProvider

The ETCDConfigProvider reads the check configs from etcd.

ZookeeperConfigProvider

The ZookeeperConfigProvider reads the check configs from zookeeper.

Documentation

Index

• Constants
• Variables
• func GetIntegrationConfigFromFile(name, fpath string) (integration.Config, error)
• func GetPollInterval(cp config.ConfigurationProviders) time.Duration
• func RegisterProvider(name string, factory ConfigProviderFactory)
• type ClusterChecksConfigProvider
  • func (c *ClusterChecksConfigProvider) Collect() ([]integration.Config, error)
  • func (c *ClusterChecksConfigProvider) GetConfigErrors() map[string]ErrorMsgSet
  • func (c *ClusterChecksConfigProvider) IsUpToDate() (bool, error)
  • func (c *ClusterChecksConfigProvider) String() string
• type ConfigProvider
  • func NewClusterChecksConfigProvider(cfg config.ConfigurationProviders) (ConfigProvider, error)
  • func NewECSConfigProvider(config config.ConfigurationProviders) (ConfigProvider, error)
• type ConfigProviderFactory
• type ECSConfigProvider
  • func (p *ECSConfigProvider) Collect() ([]integration.Config, error)
  • func (p *ECSConfigProvider) GetConfigErrors() map[string]ErrorMsgSet
  • func (p *ECSConfigProvider) IsUpToDate() (bool, error)
  • func (p *ECSConfigProvider) String() string
• type ErrorMsgSet
• type FileConfigProvider
  • func NewFileConfigProvider(paths []string) *FileConfigProvider
  • func (c *FileConfigProvider) Collect() ([]integration.Config, error)
  • func (c *FileConfigProvider) GetConfigErrors() map[string]ErrorMsgSet
  • func (c *FileConfigProvider) IsUpToDate() (bool, error)
  • func (c *FileConfigProvider) String() string
• type ProviderCache
  • func NewCPCache() *ProviderCache

Constants

const KubeEndpointsProviderName = "kube_endpoints"

KubeEndpointsProviderName defines the kube endpoints provider name

Variables

var ProviderCatalog = make(map[string]ConfigProviderFactory)

ProviderCatalog keeps track of config providers by name

Functions

func GetIntegrationConfigFromFile

func GetIntegrationConfigFromFile(name, fpath string) (integration.Config, error)

GetIntegrationConfigFromFile returns an instance of integration.Config if `fpath` points to a valid config file

func GetPollInterval

func GetPollInterval(cp config.ConfigurationProviders) time.Duration

GetPollInterval computes the poll interval from the config

func RegisterProvider

func RegisterProvider(name string, factory ConfigProviderFactory)

RegisterProvider adds a loader to the providers catalog

Types

type ClusterChecksConfigProvider

type ClusterChecksConfigProvider struct {
	// contains filtered or unexported fields
}

ClusterChecksConfigProvider implements the ConfigProvider interface for the cluster check feature.

func (*ClusterChecksConfigProvider) Collect

func (c *ClusterChecksConfigProvider) Collect() ([]integration.Config, error)

Collect retrieves configurations the cluster-agent dispatched to this agent

func (*ClusterChecksConfigProvider) GetConfigErrors

func (c *ClusterChecksConfigProvider) GetConfigErrors() map[string]ErrorMsgSet

GetConfigErrors is not implemented for the ClusterChecksConfigProvider

func (*ClusterChecksConfigProvider) IsUpToDate

func (c *ClusterChecksConfigProvider) IsUpToDate() (bool, error)

IsUpToDate queries the cluster-agent to update its status and query if new configurations are available

func (*ClusterChecksConfigProvider) String

func (c *ClusterChecksConfigProvider) String() string

String returns a string representation of the ClusterChecksConfigProvider

type ConfigProvider

type ConfigProvider interface {
	Collect() ([]integration.Config, error)
	String() string
	IsUpToDate() (bool, error)
	GetConfigErrors() map[string]ErrorMsgSet
}

ConfigProvider is the interface that wraps the Collect method

Collect is responsible of populating a list of CheckConfig instances by retrieving configuration patterns from external resources: files on disk, databases, environment variables are just few examples.

Any type implementing the interface will take care of any dependency or data needed to access the resource providing the configuration. IsUpToDate checks the local cache of the CP and returns accordingly.

func NewClusterChecksConfigProvider

func NewClusterChecksConfigProvider(cfg config.ConfigurationProviders) (ConfigProvider, error)

NewClusterChecksConfigProvider returns a new ConfigProvider collecting cluster check configurations from the cluster-agent. Connectivity is not checked at this stage to allow for retries, Collect will do it.

func NewECSConfigProvider

func NewECSConfigProvider(config config.ConfigurationProviders) (ConfigProvider, error)

NewECSConfigProvider returns a new ECSConfigProvider. It configures an http Client with a 500 ms timeout.

type ConfigProviderFactory

type ConfigProviderFactory func(cfg config.ConfigurationProviders) (ConfigProvider, error)

ConfigProviderFactory is any function capable to create a ConfigProvider instance

type ECSConfigProvider

type ECSConfigProvider struct {
	// contains filtered or unexported fields
}

ECSConfigProvider implements the ConfigProvider interface. It collects configuration templates from the ECS metadata API.

func (*ECSConfigProvider) Collect

func (p *ECSConfigProvider) Collect() ([]integration.Config, error)

Collect finds all running containers in the agent's task, reads their labels and extract configuration templates from them for auto discovery.

func (*ECSConfigProvider) GetConfigErrors

func (p *ECSConfigProvider) GetConfigErrors() map[string]ErrorMsgSet

GetConfigErrors is not implemented for the ECSConfigProvider

func (*ECSConfigProvider) IsUpToDate

func (p *ECSConfigProvider) IsUpToDate() (bool, error)

IsUpToDate updates the list of AD templates versions in the Agent's cache and checks the list is up to date compared to ECS' data.

func (*ECSConfigProvider) String

func (p *ECSConfigProvider) String() string

String returns a string representation of the ECSConfigProvider

type ErrorMsgSet

type ErrorMsgSet map[string]struct{}

ErrorMsgSet contains a unique list of configuration errors for a provider

type FileConfigProvider

type FileConfigProvider struct {
	Errors map[string]string
	// contains filtered or unexported fields
}

FileConfigProvider collect configuration files from disk

func NewFileConfigProvider

func NewFileConfigProvider(paths []string) *FileConfigProvider

NewFileConfigProvider creates a new FileConfigProvider searching for configuration files on the given paths

func (*FileConfigProvider) Collect

func (c *FileConfigProvider) Collect() ([]integration.Config, error)

Collect scans provided paths searching for configuration files. When found, it parses the files and try to unmarshall Yaml contents into a CheckConfig instance

func (*FileConfigProvider) GetConfigErrors

func (c *FileConfigProvider) GetConfigErrors() map[string]ErrorMsgSet

GetConfigErrors is not implemented for the FileConfigProvider

func (*FileConfigProvider) IsUpToDate

func (c *FileConfigProvider) IsUpToDate() (bool, error)

IsUpToDate is not implemented for the file Providers as the files are not meant to change very often.

func (*FileConfigProvider) String

func (c *FileConfigProvider) String() string

String returns a string representation of the FileConfigProvider

type ProviderCache

type ProviderCache struct {
	LatestTemplateIdx float64
	NumAdTemplates    int
}

ProviderCache contains the number of AD Templates and the latest Index

func NewCPCache

func NewCPCache() *ProviderCache

NewCPCache instantiate a ProviderCache.