talaria

README

Talaria

This sink implements sending data to a second Talaria. It can be used when there is one Talaria for event ingestion, and needs to write data to a second Talaria, which is used purely for querying data.

This sink can be enabled by adding the following configuration in the tables section:

tables:
  eventlog:
    compact:                               # enable compaction
      interval: 60                         # compact every 60 seconds
      nameFunc: "s3://bucket/namefunc.lua" # file name function
      talaria:                             # sink to Talaria
        endpoint: "127.0.0.1:8043"         # Talaria endpoint to write data to
        timeout: 5                         # Timeout for requests to Talaria
        maxConcurrent: 10                  # Number of concurrent requests to Talaria
        errorThreshold: 50                 # Percentage of errors before no more requests are sent
...

Documentation

Index

• type Writer
  • func New(endpoint string, circuitTimeout *time.Duration, maxConcurrent *int, ...) (*Writer, error)
  • func (w *Writer) Write(key key.Key, val []byte) error

Types

type Writer

type Writer struct {
	// contains filtered or unexported fields
}

Writer to write to TalariaDB

func New

func New(endpoint string, circuitTimeout *time.Duration, maxConcurrent *int, errorPercentThreshold *int) (*Writer, error)

New initializes a new Talaria writer.

func (*Writer) Write

func (w *Writer) Write(key key.Key, val []byte) error

Write will write the ORC data to Talaria