filesystem

Documentation

Overview

Package filesystem provides a client with the ability to import data into Kusto via a variety of fileystems such as local storage or blobstore.

Index

• func CompressionDiscovery(fName string) properties.CompressionType
• func IsLocalPath(s string) (bool, error)
• type Ingestion
  • func New(db, table string, mgr *resources.Manager) (*Ingestion, error)
  • func (i *Ingestion) Blob(ctx context.Context, from string, fileSize int64, props properties.All) error
  • func (i *Ingestion) Local(ctx context.Context, from string, props properties.All) error
  • func (i *Ingestion) Reader(ctx context.Context, reader io.Reader, props properties.All) (string, error)

Functions

func CompressionDiscovery

func CompressionDiscovery(fName string) properties.CompressionType

CompressionDiscovery looks at the file extension. If it is one we support, we return that CompressionType that represents that value. Otherwise we return CTNone to indicate that the file should not be compressed.

func IsLocalPath

func IsLocalPath(s string) (bool, error)

IsLocalPath detects whether a path points to a file system accessiable file If this file requires another protocol http protocol it will return false If the file requires another protocol(ftp, https, etc) it will return an error

Types

type Ingestion

type Ingestion struct {
	// contains filtered or unexported fields
}

Ingestion provides methods for taking data from a filesystem of some type and ingesting it into Kusto. This object is scoped for a single database and table.

func New

func New(db, table string, mgr *resources.Manager) (*Ingestion, error)

New is the constructor for Ingestion.

func (*Ingestion) Blob

func (i *Ingestion) Blob(ctx context.Context, from string, fileSize int64, props properties.All) error

Blob ingests a file from Azure Blob Storage into Kusto.

func (*Ingestion) Local

func (i *Ingestion) Local(ctx context.Context, from string, props properties.All) error

Local ingests a local file into Kusto.

func (*Ingestion) Reader

func (i *Ingestion) Reader(ctx context.Context, reader io.Reader, props properties.All) (string, error)

Reader uploads a file via an io.Reader. If the function succeeds, it returns the path of the created blob.