context

Documentation

Index

• Constants
• type AggregatorContext
  • func NewAggregatorContext() *AggregatorContext
  • func (p *AggregatorContext) Add(log *protocol.Log, ctx map[string]interface{}) error
  • func (*AggregatorContext) Description() string
  • func (p *AggregatorContext) Flush() []*protocol.LogGroup
  • func (p *AggregatorContext) Init(context pipeline.Context, que pipeline.LogGroupQueue) (int, error)
  • func (p *AggregatorContext) Reset()
• type LogPackSeqInfo

Constants

const (
	MaxLogCount        = 1024
	MaxLogGroupSize    = 3 * 1024 * 1024
	SmallPackIDTimeout = time.Duration(24*30) * time.Hour
	BigPackIDTimeout   = time.Duration(24) * time.Hour
	PackIDMapLenThresh = 100000
)

Types

type AggregatorContext

type AggregatorContext struct {
	MaxLogGroupCount                 int    // the maximum log group count per source to trigger flush operation
	MaxLogCount                      int    // the maximum log in a log group
	Topic                            string // the output topic
	ContextPreservationToleranceSize int    // the maximum number of log source per config where logGroupPoolMap will not be cleared periodically
	PackFlag                         bool   // whether to add __pack_id__ as a tag
	// contains filtered or unexported fields
}

func NewAggregatorContext

func NewAggregatorContext() *AggregatorContext

NewAggregatorContext create a default aggregator with default value.

func (*AggregatorContext) Add

func (p *AggregatorContext) Add(log *protocol.Log, ctx map[string]interface{}) error

Add adds @log with @ctx to aggregator.

func (*AggregatorContext) Description

func (*AggregatorContext) Description() string

func (*AggregatorContext) Flush

func (p *AggregatorContext) Flush() []*protocol.LogGroup

Flush ...

func (*AggregatorContext) Init

func (p *AggregatorContext) Init(context pipeline.Context, que pipeline.LogGroupQueue) (int, error)

Init method would be trigger before working. 1. context store the metadata of this Logstore config 2. que is a transfer channel for flushing LogGroup when reaches the maximum in the cache.

func (*AggregatorContext) Reset

func (p *AggregatorContext) Reset()

Reset ...

type LogPackSeqInfo

type LogPackSeqInfo struct {
	// contains filtered or unexported fields
}