azure

package
v1.3.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Sep 17, 2021 License: MIT Imports: 14 Imported by: 0

README

Azure Blob Storage

This sink implements Azure Blob Storage protocol. It can be enabled by adding the following configuration in the tables section:

tables:
  eventlog:
    compact:                               # enable compaction
      interval: 60                         # compact every 60 seconds
      nameFunc: "s3://bucket/namefunc.lua" # file name function
      azure:                               # sink to use
        container: "container-id-1"        # the container ID
        prefix: ""                         # (optional) prefix to add
...

This sink can write to different Storage Accounts randomly each time, if multiple storage accounts are configured

tables:
  eventlog:
    compact:                               # enable compaction
      interval: 60                         # compact every 60 seconds
      nameFunc: "s3://bucket/namefunc.lua" # file name function
      azure:                               # sink to use
        container: "container-id-1"        # the container ID
        prefix: ""                         # (optional) prefix to add
        parallelism: 0                     # (optional) default to 5
        blockSize: 5242880                 # (optional) if not set, use default
        defaultBlobServiceURL: ""          # (optional) if not set, use default
        storageAccounts:                   # (optional) if not set, use single storage writer
          - "storage-account-id-0"
          - "storage-account-id-1"
...

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func GetAzureStorageCredentials added in v1.2.7

func GetAzureStorageCredentials(monitor monitor.Monitor) (azblob.Credential, error)

Types

type MultiAccountWriter added in v1.2.7

type MultiAccountWriter struct {
	// contains filtered or unexported fields
}

MultiAccountWriter represents a writer for Microsoft Azure with multiple storage accounts.

func NewMultiAccountWriter added in v1.2.7

func NewMultiAccountWriter(monitor monitor.Monitor, blobServiceURL, container, prefix string, storageAccount []string, weights []uint, parallelism uint16, blockSize int64) (*MultiAccountWriter, error)

NewMultiAccountWriter creates a new MultiAccountWriter.

func (*MultiAccountWriter) Write added in v1.2.7

func (m *MultiAccountWriter) Write(key key.Key, val []byte) error

Write writes the data to a randomly selected storage account sink.

func (*MultiAccountWriter) WriteToContanier added in v1.2.8

func (m *MultiAccountWriter) WriteToContanier(key key.Key, val []byte, containerURL *azblob.ContainerURL) error

type Writer

type Writer struct {
	// contains filtered or unexported fields
}

Writer represents a writer for Microsoft Azure.

func New

func New(container, prefix string) (*Writer, error)

New creates a new writer.

func (*Writer) Write

func (w *Writer) Write(key key.Key, val []byte) error

Write writes the data to the sink.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL