Why Go
- Case Studies
  
  Common problems companies solve with Go
- Use Cases
  
  Stories about how and why companies use Go
- Security Policy
  
  How Go can help keep you secure by default
Learn
Docs
- Effective Go
  
  Tips for writing clear, performant, and idiomatic Go code
- Go User Manual
  
  A complete introduction to building software with Go
- Standard library
  
  Reference documentation for Go's standard library
- Release Notes
  
  Learn what's new in each Go release
Packages
Community
- Recorded Talks
  
  Videos from prior events
- Meetups
  
  Meet other local Go developers
- Conferences
  
  Learn and network with Go developers from around the world
- Go blog
  
  The Go project's official blog.
- Go project
  
  Get help and stay informed from Go
- Get connected

reader

package

Go to main page

Versions in this module

v1

v1.4.0

Sep 17, 2019

Changes in this version

type ParquetReader

+ ObjPartialType reflect.Type

+ ObjType reflect.Type

+ func (self *ParquetReader) ReadByNumber(maxReadNumber int) ([]interface{}, error)

+ func (self *ParquetReader) ReadPartial(dstInterface interface{}, prefixPath string) error

+ func (self *ParquetReader) ReadPartialByNumber(maxReadNumber int, prefixPath string) ([]interface{}, error)

v1.3.5

Sep 2, 2019

v1.3.0

May 24, 2019

Changes in this version

+ type ColumnBufferType struct

+ ChunkHeader *parquet.ColumnChunk

+ ChunkReadValues int64

+ DataTable *layout.Table

+ DataTableNumRows int64

+ DictPage *layout.Page

+ Footer *parquet.FileMetaData

+ PFile source.ParquetFile

+ PathStr string

+ RowGroupIndex int64

+ SchemaHandler *schema.SchemaHandler

+ ThriftReader *thrift.TBufferedTransport

+ func NewColumnBuffer(pFile source.ParquetFile, footer *parquet.FileMetaData, ...) (*ColumnBufferType, error)

+ func (self *ColumnBufferType) NextRowGroup() error

+ func (self *ColumnBufferType) ReadPage() error

+ func (self *ColumnBufferType) ReadPageForSkip() (*layout.Page, error)

+ func (self *ColumnBufferType) ReadRows(num int64) (*layout.Table, int64)

+ func (self *ColumnBufferType) SkipRows(num int64) int64

+ type ParquetReader struct

+ ColumnBuffers map[string]*ColumnBufferType

+ Footer *parquet.FileMetaData

+ NP int64

+ PFile source.ParquetFile

+ SchemaHandler *schema.SchemaHandler

+ func NewParquetColumnReader(pFile source.ParquetFile, np int64) (*ParquetReader, error)

+ func NewParquetReader(pFile source.ParquetFile, obj interface{}, np int64) (*ParquetReader, error)

+ func (self *ParquetReader) GetFooterSize() (uint32, error)

+ func (self *ParquetReader) GetNumRows() int64

+ func (self *ParquetReader) Read(dstInterface interface{}) error

+ func (self *ParquetReader) ReadColumnByIndex(index int, num int) (values []interface{}, rls []int32, dls []int32)

+ func (self *ParquetReader) ReadColumnByPath(pathStr string, num int) (values []interface{}, rls []int32, dls []int32)

+ func (self *ParquetReader) ReadFooter() error

+ func (self *ParquetReader) ReadStop()

+ func (self *ParquetReader) RenameSchema()

+ func (self *ParquetReader) SetSchemaHandlerFromJSON(jsonSchema string) error

+ func (self *ParquetReader) SkipRows(num int64) error

+ func (self *ParquetReader) SkipRowsByIndex(index int, num int)

+ func (self *ParquetReader) SkipRowsByPath(pathStr string, num int)