flow

package
v0.37.0-rc.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 5, 2023 License: Apache-2.0 Imports: 22 Imported by: 0

Documentation

Overview

Package flow implements the Flow component graph system. Flow configuration sources are parsed from River, which contain a listing of components to run.

Components

Each component has a set of arguments (River attributes and blocks) and optionally a set of exported fields. Components can reference the exports of other components using River expressions.

See the top-level component package for more information on components, and subpackages for defined components.

Component Health

A component will have various health states during its lifetime:

  1. Unknown: The initial health state for new components.
  2. Healthy: A healthy component
  3. Unhealthy: An unhealthy component.
  4. Exited: A component which is no longer running.

Health states are paired with a time for when the health state was generated and a message providing more detail for the health state.

Components can report their own health states. The health state reported by a component is merged with the Flow-level health of that component: an error when evaluating the configuration for a component will always be reported as unhealthy until the next successful evaluation.

Component Evaluation

The process of converting the River block associated with a component into the appropriate Go struct is called "component evaluation."

Components are only evaluated after all components they reference have been evaluated; cyclic dependencies are invalid.

If a component updates its Exports at runtime, other components which directly or indirectly reference the updated component will have their Arguments re-evaluated.

The arguments and exports for a component will be left in their last valid state if a component shuts down or is given an invalid config. This prevents a domino effect of a single failed component taking down other components which are otherwise healthy.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type Flow

type Flow struct {
	// contains filtered or unexported fields
}

Flow is the Flow system.

func New

func New(o Options) *Flow

New creates a new, unstarted Flow controller. Call Run to run the controller.

func (*Flow) GetComponent added in v0.35.0

func (f *Flow) GetComponent(id component.ID, opts component.InfoOptions) (*component.Info, error)

GetComponent implements component.Provider.

func (*Flow) GetServiceConsumers added in v0.35.0

func (f *Flow) GetServiceConsumers(serviceName string) []service.Consumer

GetServiceConsumers implements service.Host. It returns a slice of component.Component and [service.Service]s which declared a dependency on the named service.

func (*Flow) ListComponents added in v0.35.0

func (f *Flow) ListComponents(moduleID string, opts component.InfoOptions) ([]*component.Info, error)

ListComponents implements component.Provider.

func (*Flow) LoadSource added in v0.37.0

func (f *Flow) LoadSource(source *Source, args map[string]any) error

LoadSource synchronizes the state of the controller with the current config source. Components in the graph will be marked as unhealthy if there was an error encountered during Load.

The controller will only start running components after Load is called once without any configuration errors.

func (*Flow) Ready added in v0.30.0

func (f *Flow) Ready() bool

Ready returns whether the Flow controller has finished its initial load.

func (*Flow) Run added in v0.33.0

func (f *Flow) Run(ctx context.Context)

Run starts the Flow controller, blocking until the provided context is canceled. Run must only be called once.

type Options

type Options struct {
	// ControllerID is an identifier used to represent the controller.
	// ControllerID is used to generate a globally unique display name for
	// components in a binary where multiple controllers are used.
	//
	// If running multiple Flow controllers, each controller must have a
	// different value for ControllerID to be able to differentiate between
	// components in telemetry data.
	ControllerID string

	// Logger to use for controller logs and components. A no-op logger will be
	// created if this is nil.
	Logger *logging.Logger

	// Tracer for components to use. A no-op tracer will be created if this is
	// nil.
	Tracer *tracing.Tracer

	// Directory where components can write data. Constructed components will be
	// given a subdirectory of DataPath using the local ID of the component.
	//
	// If running multiple Flow controllers, each controller must have a
	// different value for DataPath to prevent components from colliding.
	DataPath string

	// Reg is the prometheus register to use
	Reg prometheus.Registerer

	// OnExportsChange is called when the exports of the controller change.
	// Exports are controlled by "export" configuration blocks. If
	// OnExportsChange is nil, export configuration blocks are not allowed in the
	// loaded config source.
	OnExportsChange func(exports map[string]any)

	// List of Services to run with the Flow controller.
	//
	// Services are configured when LoadFile is invoked. Services are started
	// when the Flow controller runs after LoadFile is invoked at least once.
	Services []service.Service
}

Options holds static options for a flow controller.

type Source added in v0.37.0

type Source struct {
	// contains filtered or unexported fields
}

A Source holds the contents of a parsed Flow source

func ParseSource added in v0.37.0

func ParseSource(name string, bb []byte) (*Source, error)

ParseSource parses the River file specified by bb into a File. name should be the name of the file used for reporting errors.

bb must not be modified after passing to ParseSource.

func ParseSources added in v0.37.0

func ParseSources(sources map[string][]byte) (*Source, error)

ParseSources parses the map of sources and combines them into a single Source. sources must not be modified after calling ParseSources.

func (*Source) RawConfigs added in v0.37.0

func (s *Source) RawConfigs() map[string][]byte

RawConfigs returns the raw source content used to create Source. Do not modify the returned map.

func (*Source) SHA256 added in v0.37.0

func (s *Source) SHA256() [sha256.Size]byte

SHA256 returns the sha256 checksum of the source. Do not modify the returned byte array.

Directories

Path Synopsis
Package componenttest provides utilities for testing Flow components.
Package componenttest provides utilities for testing Flow components.
internal
dag
Package dag defines a Directed Acyclic Graph.
Package dag defines a Directed Acyclic Graph.
testcomponents
Package testcomponents contains components useful for testing.
Package testcomponents contains components useful for testing.
testservices
Package testservices contains services useful for testing.
Package testservices contains services useful for testing.
Package tracing implements the tracing subsystem of Grafana Agent Flow.
Package tracing implements the tracing subsystem of Grafana Agent Flow.
internal/jaegerremote
Package jaegerremote implements the Jaeger Remote protocol.
Package jaegerremote implements the Jaeger Remote protocol.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL