fluentd

README

Fluentd monitoring with Netdata

Fluentd is an open source data collector for unified logging layer.

This module will monitor one or more Fluentd servers, depending on your configuration. It gathers metrics from plugin endpoint provided by in_monitor plugin.

Requirements

• fluentd with enabled monitoring agent

Metrics

All metrics have "fluentd." prefix.

Metric	Scope	Dimensions	Units
retry_count	global	a dimension per plugin	count
buffer_queue_length	global	a dimension per plugin	queue_length
buffer_total_queued_size	global	a dimension per plugin	queued_size

Configuration

Edit the go.d/fluentd.conf configuration file using edit-config from the Netdata config directory, which is typically at /etc/netdata.

cd /etc/netdata # Replace this path with your Netdata config directory
sudo ./edit-config go.d/fluentd.conf

Needs only url. Here is an example for 2 servers:

jobs:
  - name: local
    url: http://127.0.0.1:24220

  - name: local_with_filtering
    url: http://127.0.0.1:24220
    permit_plugin_id: '!monitor_agent !dummy *'

  - name: remote
    url: http://203.0.113.10:24220

By default this module collects statistics for all plugins. Filter plugins syntax: simple patterns.

For all available options please see module configuration file.

Troubleshooting

To troubleshoot issues with the fluentd collector, run the go.d.plugin with the debug option enabled. The output should give you clues as to why the collector isn't working.

• Navigate to the plugins.d directory, usually at /usr/libexec/netdata/plugins.d/. If that's not the case on your system, open netdata.conf and look for the plugins setting under [directories].

  cd /usr/libexec/netdata/plugins.d/
  

• Switch to the netdata user.

  sudo -u netdata -s
  

• Run the go.d.plugin to debug the collector:

  ./go.d.plugin -d -m fluentd
  

Documentation

Index

• type Charts
• type Config
• type Dim
• type Fluentd
  • func New() *Fluentd
  • func (f Fluentd) Charts() *Charts
  • func (f Fluentd) Check() bool
  • func (Fluentd) Cleanup()
  • func (f *Fluentd) Collect() map[string]int64
  • func (f *Fluentd) Init() bool

Types

type Charts

type Charts = module.Charts

Charts is an alias for module.Charts

type Config

type Config struct {
	web.HTTP     `yaml:",inline"`
	PermitPlugin string `yaml:"permit_plugin_id"`
}

type Dim

type Dim = module.Dim

Dim is an alias for module.Dim

type Fluentd

type Fluentd struct {
	module.Base
	Config `yaml:",inline"`
	// contains filtered or unexported fields
}

Fluentd Fluentd module.

func New

func New() *Fluentd

New creates Fluentd with default values.

func (Fluentd) Charts

func (f Fluentd) Charts() *Charts

Charts creates Charts.

func (Fluentd) Check

func (f Fluentd) Check() bool

Check makes check.

func (Fluentd) Cleanup

func (Fluentd) Cleanup()

Cleanup makes cleanup.

func (*Fluentd) Collect

func (f *Fluentd) Collect() map[string]int64

Collect collects metrics.

func (*Fluentd) Init

func (f *Fluentd) Init() bool

Init makes initialization.