batcher

Documentation

Index

• Constants
• func NewDispatcherP() counter.Provider
• type Service
  • func NewBatcher(evaluator evaluator.Evaluator, inputLen int, batchConfig config.BatcherConfig, ...) *Service
  • func (s *Service) Close() error
  • func (s *Service) Evaluate(ctx context.Context, inputs []interface{}) ([]interface{}, error)
  • func (s *Service) Start()
  • func (s *Service) Stats(r map[string]interface{})
• type ServiceMeta
  • func NewServiceMeta(m *stat.GMeter, id string) ServiceMeta

Constants

const (
	BatchNotFull = batchFull(0)
	BatchIsFull  = batchFull(1)
)

const (
	Closing   = "closing"
	FullBatch = "full"
	InstantQ  = "instant"
)

Functions

func NewDispatcherP

func NewDispatcherP() counter.Provider

Types

type Service

type Service struct {
	*adjust.Adjust
	config.BatcherConfig
	ServiceMeta
	// contains filtered or unexported fields
}

Service sits on top of an Evaluator and collects predictions calls and attempts to merge multiple calls into a single call, if they occur rapidly enough. This *can* be refactored into smaller types; but it's really more annoying than convenient.

func NewBatcher

func NewBatcher(evaluator evaluator.Evaluator, inputLen int, batchConfig config.BatcherConfig, serviceMeta ServiceMeta) *Service

func (*Service) Close

func (s *Service) Close() error

Waits for any queued batches to complete then closes underlying resources.

func (*Service) Evaluate

func (s *Service) Evaluate(ctx context.Context, inputs []interface{}) ([]interface{}, error)

Evaluate will queue a batch and wait for results. This is safe to run in any number of goroutines.

Evaluate will send the input to be (further) batched to a dispatcher, via the inputQ. See dispatcher.dispatch(), which will then call Service.queueBatch(), which pushes to batchQ. dispatcher also determines if waiting to send to batchQ is appropriate. See queueService.dispatch(), which reads from batchQ which will then finally run evaluator.Evaluator.Evaluate() when appropriate and return the response via a dedicated channel for the goroutine that called Service.Evaluate.

func (*Service) Start

func (s *Service) Start()

func (*Service) Stats

func (s *Service) Stats(r map[string]interface{})

type ServiceMeta

type ServiceMeta struct {
	// contains filtered or unexported fields
}

ServiceMeta contains things that should live longer than the life of a Service.

func NewServiceMeta

func NewServiceMeta(m *stat.GMeter, id string) ServiceMeta