filesystem

Documentation

Overview

Package filesystem provides a client with the ability to import data into Kusto via a variety of fileystems such as local storage or blobstore.

Index

• func CompressionDiscovery(fName string) properties.CompressionType
• func FormatDiscovery(fName string) properties.DataFormat
• type Ingestion
  • func New(db, table string, mgr *resources.Manager) (*Ingestion, error)
  • func (i *Ingestion) Blob(ctx context.Context, from string, fileSize int64, props properties.All) error
  • func (i *Ingestion) Local(ctx context.Context, from string, props properties.All) error

Functions

func CompressionDiscovery

func CompressionDiscovery(fName string) properties.CompressionType

CompressionDiscovery looks at the file extension. If it is one we support, we return that CompressionType that represents that value. Otherwise we return CTNone to indicate that the file should not be compressed.

func FormatDiscovery

func FormatDiscovery(fName string) properties.DataFormat

FormatDiscovery looks at the file name and tries to discern what the file format is.

Types

type Ingestion

type Ingestion struct {
	// contains filtered or unexported fields
}

Ingestion provides methods for taking data from a filesystem of some type and ingesting it into Kusto. This object is scoped for a single database and table.

func New

func New(db, table string, mgr *resources.Manager) (*Ingestion, error)

New is the constructor for Ingestion.

func (*Ingestion) Blob

func (i *Ingestion) Blob(ctx context.Context, from string, fileSize int64, props properties.All) error

Blob ingests a file from Azure Blob Storage into Kusto.

func (*Ingestion) Local

func (i *Ingestion) Local(ctx context.Context, from string, props properties.All) error

Local ingests a local file into Kusto.