nodetally

Documentation

Index

• Variables
• type Observer
  • func NewObserver(log *zap.Logger, now time.Time) *Observer
  • func (observer *Observer) InlineSegment(ctx context.Context, segment *segmentloop.Segment) (err error)
  • func (observer *Observer) LoopStarted(context.Context, segmentloop.LoopInfo) (err error)
  • func (observer *Observer) RemoteSegment(ctx context.Context, segment *segmentloop.Segment) error
• type RangedLoopObserver
  • func NewRangedLoopObserver(log *zap.Logger, accounting accounting.StoragenodeAccounting) *RangedLoopObserver
  • func (observer *RangedLoopObserver) Finish(ctx context.Context) error
  • func (observer *RangedLoopObserver) Fork(ctx context.Context) (rangedloop.Partial, error)
  • func (observer *RangedLoopObserver) Join(ctx context.Context, partial rangedloop.Partial) error
  • func (observer *RangedLoopObserver) SetNow(nowFn func() time.Time)
  • func (observer *RangedLoopObserver) Start(ctx context.Context, time time.Time) (err error)
• type RangedLoopPartial
  • func NewRangedLoopPartial(log *zap.Logger, nowFn func() time.Time) *RangedLoopPartial
  • func (partial *RangedLoopPartial) Process(ctx context.Context, segments []segmentloop.Segment) error
• type Service
  • func New(log *zap.Logger, sdb accounting.StoragenodeAccounting, ...) *Service
  • func (service *Service) Close() error
  • func (service *Service) Run(ctx context.Context) (err error)
  • func (service *Service) SetNow(now func() time.Time)
  • func (service *Service) Tally(ctx context.Context) (err error)

Variables

var (
	Error = errs.Class("node tally")
)

Error is a standard error class for this package.

Types

type Observer

type Observer struct {
	Node map[storj.NodeID]float64
	// contains filtered or unexported fields
}

Observer observes metainfo and adds up tallies for nodes and buckets.

func NewObserver

func NewObserver(log *zap.Logger, now time.Time) *Observer

NewObserver returns an segment loop observer that adds up totals for nodes.

func (*Observer) InlineSegment

func (observer *Observer) InlineSegment(ctx context.Context, segment *segmentloop.Segment) (err error)

InlineSegment is called for each inline segment.

func (*Observer) LoopStarted

func (observer *Observer) LoopStarted(context.Context, segmentloop.LoopInfo) (err error)

LoopStarted is called at each start of a loop.

func (*Observer) RemoteSegment

func (observer *Observer) RemoteSegment(ctx context.Context, segment *segmentloop.Segment) error

RemoteSegment is called for each remote segment.

type RangedLoopObserver

type RangedLoopObserver struct {
	Node map[storj.NodeID]float64
	// contains filtered or unexported fields
}

RangedLoopObserver implements node tally ranged loop observer.

func NewRangedLoopObserver

func NewRangedLoopObserver(log *zap.Logger, accounting accounting.StoragenodeAccounting) *RangedLoopObserver

NewRangedLoopObserver creates new RangedLoopObserver.

func (*RangedLoopObserver) Finish

func (observer *RangedLoopObserver) Finish(ctx context.Context) error

Finish calculates byte*hours from per node storage usage and save tallies to DB.

func (*RangedLoopObserver) Fork

func (observer *RangedLoopObserver) Fork(ctx context.Context) (rangedloop.Partial, error)

Fork forks new node tally ranged loop partial.

func (*RangedLoopObserver) Join

func (observer *RangedLoopObserver) Join(ctx context.Context, partial rangedloop.Partial) error

Join joins node tally ranged loop partial to main observer updating main per node usage map.

func (*RangedLoopObserver) SetNow

func (observer *RangedLoopObserver) SetNow(nowFn func() time.Time)

SetNow overrides the timestamp used to store the result.

func (*RangedLoopObserver) Start

func (observer *RangedLoopObserver) Start(ctx context.Context, time time.Time) (err error)

Start implements ranged loop observer start method.

type RangedLoopPartial

type RangedLoopPartial struct {
	Node map[storj.NodeID]float64
	// contains filtered or unexported fields
}

RangedLoopPartial implements node tally ranged loop partial.

func NewRangedLoopPartial

func NewRangedLoopPartial(log *zap.Logger, nowFn func() time.Time) *RangedLoopPartial

NewRangedLoopPartial creates new node tally ranged loop partial.

func (*RangedLoopPartial) Process

func (partial *RangedLoopPartial) Process(ctx context.Context, segments []segmentloop.Segment) error

Process iterates over segment range updating partial node usage map.

type Service

type Service struct {
	Loop *sync2.Cycle
	// contains filtered or unexported fields
}

Service is the tally service for data stored on each storage node.

architecture: Chore

func New

func New(log *zap.Logger, sdb accounting.StoragenodeAccounting, loop *segmentloop.Service, interval time.Duration) *Service

New creates a new node tally Service.

func (*Service) Close

func (service *Service) Close() error

Close stops the service and releases any resources.

func (*Service) Run

func (service *Service) Run(ctx context.Context) (err error)

Run the node tally service loop.

func (*Service) SetNow

func (service *Service) SetNow(now func() time.Time)

SetNow allows tests to have the Service act as if the current time is whatever they want. This avoids races and sleeping, making tests more reliable and efficient.

func (*Service) Tally

func (service *Service) Tally(ctx context.Context) (err error)

Tally calculates data-at-rest usage once.