sources

Documentation

Index

• func GetPartitionedBufferIdx() func(toVertex string, toVertexPartitionCount int) int32
• type SourceProcessor
  • func (sp *SourceProcessor) Start(ctx context.Context) error
• type Sourcer

Functions

func GetPartitionedBufferIdx

func GetPartitionedBufferIdx() func(toVertex string, toVertexPartitionCount int) int32

GetPartitionedBufferIdx returns a function that returns a partitioned buffer index based on the toVertex name and the partition count it distributes the messages evenly to the partitions of the toVertex based on the message count(round robin)

Types

type SourceProcessor

type SourceProcessor struct {
	ISBSvcType     dfv1.ISBSvcType
	VertexInstance *dfv1.VertexInstance
}

func (*SourceProcessor) Start

func (sp *SourceProcessor) Start(ctx context.Context) error

type Sourcer

type Sourcer interface {
	isb.BufferReader
	forward.StarterStopper
}

Sourcer interface provides an isb.BufferReader abstraction over the underlying data source. This is intended to be consumed by a connector like isb.forward