Documentation ¶
Index ¶
Constants ¶
const BatchLen = 100
Variables ¶
This section is empty.
Functions ¶
func FromFunction ¶
Types ¶
type Context ¶
type Context struct { context.Context Logger *zap.Logger Warnings chan string Zctx *zed.Context // contains filtered or unexported fields }
Context provides states used by all procs to provide the outside context in which they are running.
func DefaultContext ¶
func DefaultContext() *Context
func NewContext ¶
type DataAdaptor ¶
type DataAdaptor interface { PoolID(context.Context, string) (ksuid.KSUID, error) CommitObject(context.Context, ksuid.KSUID, string) (ksuid.KSUID, error) Layout(context.Context, dag.Source) order.Layout NewScheduler(context.Context, *zed.Context, dag.Source, extent.Span, zbuf.Filter, *dag.Filter) (Scheduler, error) Open(context.Context, *zed.Context, string, zbuf.Filter) (zbuf.PullerCloser, error) }
type Interface ¶
proc.Interface is the interface to objects that operate on Batches of zed.Records and are arranged into a flowgraph to perform pattern matching and analytics. A proc is generally single-threaded unless lengths are taken to implement concurrency within a Proc. The model is receiver-driven, stream-oriented data processing. Downstream procs Pull() batches of data from upstream procs. Normally, a proc pulls data until end of stream (nil batch and nil error) or error (nil batch and non-nil error). If a proc wants to end before end of stream, it calls the Done() method on its parent. A proc implementation may assume calls to Pull() and Done() are single threaded so any arrangement of calls to Pull() and Done() cannot be done concurrently. In short, never call Done() concurrently to another goroutine calling Pull().
type Scheduler ¶
type Scheduler interface { PullScanTask() (zbuf.PullerCloser, error) Stats() zbuf.ScannerStats }
Directories ¶
Path | Synopsis |
---|---|
A combine proc merges multiple upstream inputs into one output.
|
A combine proc merges multiple upstream inputs into one output. |
A mux proc merges multiple upstream inputs into one output like combine but labels each batch.
|
A mux proc merges multiple upstream inputs into one output like combine but labels each batch. |
rename renames one or more fields in a record.
|
rename renames one or more fields in a record. |