minio

Documentation

Index

• func NewS3FileReaderWithClient(ctx context.Context, s3Client *minio.Client, bucket string, key string) (source.ParquetFile, error)
• func NewS3FileWriterWithClient(ctx context.Context, s3Client *minio.Client, bucket string, key string) (source.ParquetFile, error)
• type MinioFile
  • func (s *MinioFile) Close() error
  • func (s *MinioFile) Create(key string) (source.ParquetFile, error)
  • func (s *MinioFile) Open(name string) (source.ParquetFile, error)
  • func (s *MinioFile) Read(p []byte) (n int, err error)
  • func (s *MinioFile) Seek(offset int64, whence int) (int64, error)
  • func (s *MinioFile) Write(p []byte) (n int, err error)

Functions

func NewS3FileReaderWithClient

func NewS3FileReaderWithClient(ctx context.Context, s3Client *minio.Client, bucket string, key string) (source.ParquetFile, error)

NewS3FileReaderWithClient is the same as NewMinioFileReader but allows passing your own S3 client

func NewS3FileWriterWithClient

func NewS3FileWriterWithClient(
	ctx context.Context,
	s3Client *minio.Client,
	bucket string,
	key string,
) (source.ParquetFile, error)

NewS3FileWriterWithClient is the same as NewMinioFileWriter but allows passing your own S3 client.

Types

type MinioFile

type MinioFile struct {
	BucketName string
	Key        string
	// contains filtered or unexported fields
}

MinioFile is ParquetFile for MinIO S3 API

func (*MinioFile) Close

func (s *MinioFile) Close() error

Close signals write completion and cleans up any open streams. Will block until pending uploads are complete.

func (*MinioFile) Create

func (s *MinioFile) Create(key string) (source.ParquetFile, error)

Create creates a new Minio File instance to perform writes

func (*MinioFile) Open

func (s *MinioFile) Open(name string) (source.ParquetFile, error)

Open creates a new Minio File instance to perform concurrent reads

func (*MinioFile) Read

func (s *MinioFile) Read(p []byte) (n int, err error)

Read up to len(p) bytes into p and return the number of bytes read

func (*MinioFile) Seek

func (s *MinioFile) Seek(offset int64, whence int) (int64, error)

Seek tracks the offset for the next Read. Has no effect on Write.

func (*MinioFile) Write

func (s *MinioFile) Write(p []byte) (n int, err error)

Write len(p) bytes from p to the Minio data stream