distributor

Documentation

Overview

Package distributor is a complex implementation of a Torus storage interface, that understands rebalancing it's underlying storage and fetching data from peers, as necessary.

Index

• Variables
• func ListenReplication(s *torus.Server, addr *url.URL) error
• func OpenReplication(s *torus.Server) error
• type Distributor
  • func (d *Distributor) Block(ctx context.Context, ref torus.BlockRef) ([]byte, error)
  • func (d *Distributor) BlockIterator() torus.BlockIterator
  • func (d *Distributor) BlockSize() uint64
  • func (d *Distributor) Close() error
  • func (d *Distributor) DeleteBlock(ctx context.Context, i torus.BlockRef) error
  • func (d *Distributor) Flush() error
  • func (d *Distributor) GetBlock(ctx context.Context, i torus.BlockRef) ([]byte, error)
  • func (d *Distributor) HasBlock(ctx context.Context, i torus.BlockRef) (bool, error)
  • func (d *Distributor) Kind() string
  • func (d *Distributor) NumBlocks() uint64
  • func (d *Distributor) PutBlock(ctx context.Context, ref torus.BlockRef, data []byte) error
  • func (d *Distributor) RebalanceCheck(ctx context.Context, refs []torus.BlockRef) ([]bool, error)
  • func (d *Distributor) Ring() torus.Ring
  • func (d *Distributor) UUID() string
  • func (d *Distributor) UsedBlocks() uint64
  • func (d *Distributor) WriteBlock(ctx context.Context, i torus.BlockRef, data []byte) error
  • func (d *Distributor) WriteBuf(ctx context.Context, i torus.BlockRef) ([]byte, error)

Variables

var (
	ErrNoPeersBlock = errors.New("distributor: no peers available for a block")
)

Functions

func ListenReplication

func ListenReplication(s *torus.Server, addr *url.URL) error

ListenReplication opens the internal networking port and connects to the cluster

func OpenReplication

func OpenReplication(s *torus.Server) error

OpenReplication connects to the cluster without opening the internal networking.

Types

type Distributor

type Distributor struct {
	// contains filtered or unexported fields
}

func (*Distributor) Block

func (d *Distributor) Block(ctx context.Context, ref torus.BlockRef) ([]byte, error)

func (*Distributor) BlockIterator

func (d *Distributor) BlockIterator() torus.BlockIterator

func (*Distributor) BlockSize

func (d *Distributor) BlockSize() uint64

func (*Distributor) Close

func (d *Distributor) Close() error

func (*Distributor) DeleteBlock

func (d *Distributor) DeleteBlock(ctx context.Context, i torus.BlockRef) error

func (*Distributor) Flush

func (d *Distributor) Flush() error

func (*Distributor) GetBlock

func (d *Distributor) GetBlock(ctx context.Context, i torus.BlockRef) ([]byte, error)

func (*Distributor) HasBlock

func (d *Distributor) HasBlock(ctx context.Context, i torus.BlockRef) (bool, error)

func (*Distributor) Kind

func (d *Distributor) Kind() string

func (*Distributor) NumBlocks

func (d *Distributor) NumBlocks() uint64

func (*Distributor) PutBlock

func (d *Distributor) PutBlock(ctx context.Context, ref torus.BlockRef, data []byte) error

PutBlock server side implementation which is called from RPC client.

func (*Distributor) RebalanceCheck

func (d *Distributor) RebalanceCheck(ctx context.Context, refs []torus.BlockRef) ([]bool, error)

func (*Distributor) Ring

func (d *Distributor) Ring() torus.Ring

func (*Distributor) UUID

func (d *Distributor) UUID() string

func (*Distributor) UsedBlocks

func (d *Distributor) UsedBlocks() uint64

func (*Distributor) WriteBlock

func (d *Distributor) WriteBlock(ctx context.Context, i torus.BlockRef, data []byte) error

func (*Distributor) WriteBuf

func (d *Distributor) WriteBuf(ctx context.Context, i torus.BlockRef) ([]byte, error)