partition

Documentation

Overview

Package partition comprises code related to the manipulation of Partitioned data, exposed as Rows

Index

• Variables
• func CreateBuildablePartition(maxRows int, schema sif.Schema) sif.BuildablePartition
• func CreateKeyedReduceablePartition(maxRows int, schema sif.Schema) sif.ReduceablePartition
• func CreatePartition(maxRows int, initialCapacity int, schema sif.Schema) sif.Partition
• func CreateReduceablePartition(maxRows int, schema sif.Schema) sif.ReduceablePartition
• func CreateTempRow() sif.Row
• func FromBytes(data []byte, schema sif.Schema, compressor sif.Compressor) (sif.ReduceablePartition, error)
• func FromStreamedData(stream pb.PartitionsService_TransferPartitionDataClient, ...) (sif.Partition, error)

Variables

var File_partition_proto protoreflect.FileDescriptor

Functions

func CreateBuildablePartition

func CreateBuildablePartition(maxRows int, schema sif.Schema) sif.BuildablePartition

CreateBuildablePartition creates a new Partition containing an empty byte array and a schema

func CreateKeyedReduceablePartition

func CreateKeyedReduceablePartition(maxRows int, schema sif.Schema) sif.ReduceablePartition

CreateKeyedReduceablePartition creates a new Partition containing an empty byte array and a schema

func CreatePartition

func CreatePartition(maxRows int, initialCapacity int, schema sif.Schema) sif.Partition

CreatePartition creates a new Partition containing an empty byte array and a schema

func CreateReduceablePartition

func CreateReduceablePartition(maxRows int, schema sif.Schema) sif.ReduceablePartition

CreateReduceablePartition creates a new Partition containing an empty byte array and a schema

func CreateTempRow

func CreateTempRow() sif.Row

CreateTempRow builds an empty row struct which cannot be used until passed to a function which populates it with data

func FromBytes

func FromBytes(data []byte, schema sif.Schema, compressor sif.Compressor) (sif.ReduceablePartition, error)

FromBytes converts serialized bytes into a Partition

func FromStreamedData

func FromStreamedData(stream pb.PartitionsService_TransferPartitionDataClient, partitionMeta *pb.MPartitionMeta, schema sif.Schema, compressor sif.Compressor) (sif.Partition, error)

FromStreamedData loads data from a protobuf stream into this Partition