harvester

Documentation

Overview

The harvester package harvest different inputs for new information. Currently two harvester types exist:

• log
• stdin

The log harvester reads a file line by line. In case the end of a file is found with an incomplete line, the line pointer stays at the beginning of the incomplete line. As soon as the line is completed, it is read and returned.

The stdin harvesters reads data from stdin.

Index

• Variables
• func MatchAnyRegexps(regexps []*regexp.Regexp, text string) bool
• type Harvester
  • func NewHarvester(cfg *common.Config, state file.State, prospectorChan chan *input.Event, ...) (*Harvester, error)
  • func (h *Harvester) Harvest()
• type LogFile
  • func NewLogFile(fs source.FileSource, config harvesterConfig, done chan struct{}) (*LogFile, error)
  • func (r *LogFile) Read(buf []byte) (int, error)

Variables

var (
	ErrFileTruncate = errors.New("detected file being truncated")
	ErrRenamed      = errors.New("file was renamed")
	ErrRemoved      = errors.New("file was removed")
	ErrInactive     = errors.New("file inactive")
	ErrClosed       = errors.New("reader closed")
)

Functions

func MatchAnyRegexps

func MatchAnyRegexps(regexps []*regexp.Regexp, text string) bool

MatchAnyRegexps checks if the text matches any of the regular expressions

Types

type Harvester

type Harvester struct {
	// contains filtered or unexported fields
}

func NewHarvester

func NewHarvester(
	cfg *common.Config,
	state file.State,
	prospectorChan chan *input.Event,
	done chan struct{},
) (*Harvester, error)

func (*Harvester) Harvest

func (h *Harvester) Harvest()

Log harvester reads files line by line and sends events to the defined output

type LogFile

type LogFile struct {
	// contains filtered or unexported fields
}

func NewLogFile

func NewLogFile(
	fs source.FileSource,
	config harvesterConfig,
	done chan struct{},
) (*LogFile, error)

func (*LogFile) Read

func (r *LogFile) Read(buf []byte) (int, error)