generator

Documentation

Overview

Package generator contains an implementation of an in-memory generator that generates payloads in json format.

Index

• func NewMemGen(vertexInstance *dfv1.VertexInstance, writers map[string][]isb.BufferWriter, ...) (*memgen, error)
• type Data
• type Option
  • func WithLogger(l *zap.SugaredLogger) Option
  • func WithReadTimeout(timeout time.Duration) Option

Functions

func NewMemGen

func NewMemGen(
	vertexInstance *dfv1.VertexInstance,
	writers map[string][]isb.BufferWriter,
	fsd forward.ToWhichStepDecider,
	transformerApplier applier2.SourceTransformApplier,
	fetchWM fetch.Fetcher,
	toVertexPublisherStores map[string]store.WatermarkStore,
	publishWMStores store.WatermarkStore,
	idleManager wmb.IdleManager,
	opts ...Option) (*memgen, error)

NewMemGen function creates an instance of generator.

Types

type Data

type Data struct {
	Value uint64 `json:"value,omitempty"`
	// only to ensure a desired message size
	Padding []byte `json:"padding,omitempty"`
}

type Option

type Option func(*memgen) error

func WithLogger

func WithLogger(l *zap.SugaredLogger) Option

WithLogger is used to return logger information

func WithReadTimeout

func WithReadTimeout(timeout time.Duration) Option