partitioning

Documentation

Index

• type DataSplit
  • func (ds *DataSplit) SplitDataInChunks(data [][]byte, limit int) ([][][]byte, error)
• type SizeDataPacker
  • func NewSizeDataPacker(marshalizer marshal.Marshalizer) (*SizeDataPacker, error)
  • func (sdp *SizeDataPacker) PackDataInChunks(data [][]byte, limit int) ([][]byte, error)

Types

type DataSplit

type DataSplit struct {
}

DataSplit can split a large slice of byte slices in chunks with len(chunks) <= limit It does not marshal the data

func (*DataSplit) SplitDataInChunks

func (ds *DataSplit) SplitDataInChunks(data [][]byte, limit int) ([][][]byte, error)

SplitDataInChunks splits the provided data into smaller chunks limit is expressed in number of elements

type SizeDataPacker

type SizeDataPacker struct {
	// contains filtered or unexported fields
}

SizeDataPacker can split a large slice of byte slices in chunks <= maxPacketSize If one element still exceeds maxPacketSize, it will be returned alone It does the marshaling of the resulted (smaller) slice of byte slices

func NewSizeDataPacker

func NewSizeDataPacker(marshalizer marshal.Marshalizer) (*SizeDataPacker, error)

NewSizeDataPacker creates a new SizeDataPacker instance

func (*SizeDataPacker) PackDataInChunks

func (sdp *SizeDataPacker) PackDataInChunks(data [][]byte, limit int) ([][]byte, error)

PackDataInChunks packs the provided data into smaller chunks limit is expressed in bytes