pipeline

Documentation

Index

• Constants
• func StartFLPInProcess(cfg *config.ConfigFileStruct, in chan config.GenericMap) error
• type Error
  • func (e *Error) Error() string
  • func (e *Error) Unwrap() error
• type Pipeline
  • func NewPipeline(cfg *config.ConfigFileStruct) (*Pipeline, error)
  • func (p *Pipeline) IsAlive() error
  • func (p *Pipeline) IsReady() error
  • func (p *Pipeline) Run()

Constants

const (
	StageIngest    = "ingest"
	StageTransform = "transform"
	StageExtract   = "extract"
	StageEncode    = "encode"
	StageWrite     = "write"
)

interface definitions of pipeline components

Functions

func StartFLPInProcess

func StartFLPInProcess(cfg *config.ConfigFileStruct, in chan config.GenericMap) error

StartFLPInProcess is an entry point to start the whole FLP / pipeline processing from imported code

Types

type Error

type Error struct {
	StageName string
	// contains filtered or unexported fields
}

Error wraps any error caused by a wrong formation of the pipeline

func (*Error) Error

func (e *Error) Error() string

func (*Error) Unwrap

func (e *Error) Unwrap() error

type Pipeline

type Pipeline struct {
	IsRunning bool

	Metrics *operational.Metrics
	// contains filtered or unexported fields
}

Pipeline manager

func NewPipeline

func NewPipeline(cfg *config.ConfigFileStruct) (*Pipeline, error)

NewPipeline defines the pipeline elements

func (*Pipeline) IsAlive

func (p *Pipeline) IsAlive() error

func (*Pipeline) IsReady

func (p *Pipeline) IsReady() error

func (*Pipeline) Run

func (p *Pipeline) Run()