parquet

Documentation

Overview

	Package parquetgo is an utility and marshaler with go-friendly error handling for parquet-go.
	https://github.com/xitongsys/parquet-go

	xitongsys/parquet-go provides simple, high-level API to convert to Parquet.
	But provided features are limited (mainly it looks main users select Go struct or JSON ),
    and the error handling is sometimes too simple (panic/recovery based).

	parquetgo package enriches these points for handling Arrow based data.

Index

• Variables
• func MarshalArrow(maybeRecord []interface{}, bgn int, end int, ...) (*map[string]*layout.Table, error)
• func MarshalMap(sources []interface{}, bgn int, end int, schemaHandler *schema.SchemaHandler) (*map[string]*layout.Table, error)
• func NewStdioFile() *stdioFile

Variables

var (
	ErrInvalidParquetSchema = errors.New("invalid parquet schema")
	ErrInvalidParquetRecord = errors.New("invalid parquet record")
	ErrUnsupportedMethod    = errors.New("unsupported method")
)

Functions

func MarshalArrow

func MarshalArrow(maybeRecord []interface{}, bgn int, end int, schemaHandler *schema.SchemaHandler) (*map[string]*layout.Table, error)

MarshalMap converts 1 arrow record to parquet tables.

func MarshalMap

func MarshalMap(sources []interface{}, bgn int, end int, schemaHandler *schema.SchemaHandler) (*map[string]*layout.Table, error)

MarshalMap converts []map[string]interface{} to parquet tables.

func NewStdioFile

func NewStdioFile() *stdioFile