verify

Documentation

Index

• Variables
• type Chore
  • func New(log *zap.Logger, mdb *metabase.DB, config Config) *Chore
  • func (chore *Chore) RunOnce(ctx context.Context) error
• type Config
• type ProgressObserver
  • func (progress *ProgressObserver) Finish(context.Context) error
  • func (progress *ProgressObserver) Fork(context.Context) (rangedloop.Partial, error)
  • func (progress *ProgressObserver) Join(context.Context, rangedloop.Partial) error
  • func (progress *ProgressObserver) Process(ctx context.Context, segments []rangedloop.Segment) error
  • func (progress *ProgressObserver) Report()
  • func (progress *ProgressObserver) Start(context.Context, time.Time) error
• type SegmentSizes
  • func (verify *SegmentSizes) Finish(context.Context) error
  • func (verify *SegmentSizes) Fork(context.Context) (rangedloop.Partial, error)
  • func (verify *SegmentSizes) Join(context.Context, rangedloop.Partial) error
  • func (verify *SegmentSizes) Process(ctx context.Context, segments []rangedloop.Segment) error
  • func (verify *SegmentSizes) Start(context.Context, time.Time) error

Variables

var Error = errs.Class("verify")

Error is the default error class for the package.

Types

type Chore

type Chore struct {
	Log *zap.Logger

	Config Config

	DB *metabase.DB
}

Chore runs different verifications on metabase loop.

func New

func New(log *zap.Logger, mdb *metabase.DB, config Config) *Chore

New creates new verification.

func (*Chore) RunOnce

func (chore *Chore) RunOnce(ctx context.Context) error

RunOnce creates a new rangedloop and runs the verifications.

type Config

type Config struct {
	ProgressPrintFrequency int64

	Loop rangedloop.Config
}

Config contains configuration for all the services.

type ProgressObserver

type ProgressObserver struct {
	Log *zap.Logger

	ProgressPrintFrequency int64
	RemoteSegmentCount     int64
	InlineSegmentCount     int64
	// contains filtered or unexported fields
}

ProgressObserver counts and prints progress of metabase loop.

func (*ProgressObserver) Finish

func (progress *ProgressObserver) Finish(context.Context) error

Finish is called after all segments are processed by all observers.

func (*ProgressObserver) Fork

func (progress *ProgressObserver) Fork(context.Context) (rangedloop.Partial, error)

Fork creates a Partial to process a chunk of all the segments. It is called after Start. It is not called concurrently.

func (*ProgressObserver) Join

func (progress *ProgressObserver) Join(context.Context, rangedloop.Partial) error

Join is called for each partial returned by Fork.

func (*ProgressObserver) Process

func (progress *ProgressObserver) Process(ctx context.Context, segments []rangedloop.Segment) error

Process is called repeatedly with batches of segments.

func (*ProgressObserver) Report

func (progress *ProgressObserver) Report()

Report reports the current progress.

func (*ProgressObserver) Start

func (progress *ProgressObserver) Start(context.Context, time.Time) error

Start is called at the beginning of each segment loop.

type SegmentSizes

type SegmentSizes struct {
	Log *zap.Logger
	// contains filtered or unexported fields
}

SegmentSizes verifies segments table plain_offset and plain_size.

func (*SegmentSizes) Finish

func (verify *SegmentSizes) Finish(context.Context) error

Finish is called after all segments are processed by all observers.

func (*SegmentSizes) Fork

func (verify *SegmentSizes) Fork(context.Context) (rangedloop.Partial, error)

Fork creates a Partial to process a chunk of all the segments. It is called after Start. It is not called concurrently.

func (*SegmentSizes) Join

func (verify *SegmentSizes) Join(context.Context, rangedloop.Partial) error

Join is called for each partial returned by Fork.

func (*SegmentSizes) Process

func (verify *SegmentSizes) Process(ctx context.Context, segments []rangedloop.Segment) error

Process is called repeatedly with batches of segments.

func (*SegmentSizes) Start

func (verify *SegmentSizes) Start(context.Context, time.Time) error

Start is called at the beginning of each segment loop.