Documentation ¶
Index ¶
- func NewAzBlobFileReader(ctx context.Context, URL string, credential azblob.Credential, ...) (source.ParquetFile, error)
- func NewAzBlobFileWriter(ctx context.Context, URL string, credential azblob.Credential, ...) (source.ParquetFile, error)
- type AzBlockBlob
- func (s *AzBlockBlob) Close() error
- func (s *AzBlockBlob) Create(URL string) (source.ParquetFile, error)
- func (s *AzBlockBlob) Open(URL string) (source.ParquetFile, error)
- func (s *AzBlockBlob) Read(p []byte) (n int, err error)
- func (s *AzBlockBlob) Seek(offset int64, whence int) (int64, error)
- func (s *AzBlockBlob) Write(p []byte) (n int, err error)
- type ReaderOptions
- type WriterOptions
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func NewAzBlobFileReader ¶
func NewAzBlobFileReader(ctx context.Context, URL string, credential azblob.Credential, options ReaderOptions) (source.ParquetFile, error)
NewAzBlobFileReader creates an Azure Blob FileReader, to be used with NewParquetReader
func NewAzBlobFileWriter ¶
func NewAzBlobFileWriter(ctx context.Context, URL string, credential azblob.Credential, options WriterOptions) (source.ParquetFile, error)
NewAzBlobFileWriter creates an Azure Blob FileWriter, to be used with NewParquetWriter
Types ¶
type AzBlockBlob ¶
AzBlockBlob is ParquetFile for azblob
func (*AzBlockBlob) Close ¶
func (s *AzBlockBlob) Close() error
Close signals write completion and cleans up any open streams. Will block until pending uploads are complete.
func (*AzBlockBlob) Create ¶
func (s *AzBlockBlob) Create(URL string) (source.ParquetFile, error)
Create a new blob url to perform writes
func (*AzBlockBlob) Open ¶
func (s *AzBlockBlob) Open(URL string) (source.ParquetFile, error)
Open creates a new block blob to perform reads
func (*AzBlockBlob) Read ¶
func (s *AzBlockBlob) Read(p []byte) (n int, err error)
Read up to len(p) bytes into p and return the number of bytes read
type ReaderOptions ¶
type ReaderOptions struct { // HTTPSender configures the sender of HTTP requests HTTPSender pipeline.Factory // Retry configures the built-in retry policy behavior. RetryOptions azblob.RetryOptions // Log configures the pipeline's logging infrastructure indicating what information is logged and where. Log pipeline.LogOptions }
ReaderOptions is used to configure azblob read behavior, including HTTP, retry, and logging settings
type WriterOptions ¶
type WriterOptions struct { // HTTPSender configures the sender of HTTP requests HTTPSender pipeline.Factory // Retry configures the built-in retry policy behavior. RetryOptions azblob.RetryOptions // Log configures the pipeline's logging infrastructure indicating what information is logged and where. Log pipeline.LogOptions // Parallelism limits the number of go routines created to read blob content (0 = default) Parallelism int }
WriterOptions is used to configure azblob write behavior, including HTTP, retry, and logging settings