elasticsearch

Documentation

Overview

Package elasticsearch contains logic to record data to an elasticsearch index. The data is already sanitised by the data provider.

Index

• type Conf
  • func WithLogger(log tools.FieldLogger) Conf
  • func WithViper(v unmarshaller, name, key string) Conf
• type Config
  • func NewConfig(conf ...Conf) (*Config, error)
  • func (c *Config) Backoff() int
  • func (c *Config) Endpoint() string
  • func (c *Config) IndexName() string
  • func (c *Config) Logger() tools.FieldLogger
  • func (c *Config) Name() string
  • func (c *Config) Recorder() (recorder.DataRecorder, error)
  • func (c *Config) Timeout() time.Duration
• type Recorder
  • func New(options ...func(recorder.Constructor) error) (*Recorder, error)
  • func (r *Recorder) Backoff() int
  • func (r *Recorder) Endpoint() string
  • func (r *Recorder) IndexName() string
  • func (r *Recorder) Name() string
  • func (r *Recorder) Ping() error
  • func (r *Recorder) Record(ctx context.Context, job recorder.Job) error
  • func (r *Recorder) SetBackoff(backoff int)
  • func (r *Recorder) SetEndpoint(endpoint string)
  • func (r *Recorder) SetIndexName(indexName string)
  • func (r *Recorder) SetLogger(log tools.FieldLogger)
  • func (r *Recorder) SetName(name string)
  • func (r *Recorder) SetTimeout(timeout time.Duration)
  • func (r *Recorder) Timeout() time.Duration

Types

type Conf

type Conf func(*Config) error

Conf func is used for initializing a Config object.

func WithLogger

func WithLogger(log tools.FieldLogger) Conf

WithLogger produces an error if the log is nil.

func WithViper

func WithViper(v unmarshaller, name, key string) Conf

WithViper produces an error any of the inputs are empty.

type Config

type Config struct {
	ESEndpoint  string `mapstructure:"endpoint"`
	ESTimeout   string `mapstructure:"timeout"`
	ESBackoff   int    `mapstructure:"backoff"`
	ESIndexName string `mapstructure:"index_name"`

	ESName      string
	ConfTimeout time.Duration
	// contains filtered or unexported fields
}

Config holds the necessary configuration for setting up an elasticsearch reader endpoint from a configuration file.

func NewConfig

func NewConfig(conf ...Conf) (*Config, error)

NewConfig is used for returning the values from config file. It returns any errors that any of conf function return.

func (*Config) Backoff

func (c *Config) Backoff() int

Backoff return the backoff

func (*Config) Endpoint

func (c *Config) Endpoint() string

Endpoint return the endpoint

func (*Config) IndexName

func (c *Config) IndexName() string

IndexName return the index name

func (*Config) Logger

func (c *Config) Logger() tools.FieldLogger

Logger return the logger

func (*Config) Name

func (c *Config) Name() string

Name return the name

func (*Config) Recorder

func (c *Config) Recorder() (recorder.DataRecorder, error)

Recorder implements the RecorderConf interface.

func (*Config) Timeout

func (c *Config) Timeout() time.Duration

Timeout return the timeout

type Recorder

type Recorder struct {
	// contains filtered or unexported fields
}

Recorder contains an elasticsearch client and an index name for recording data. It implements DataRecorder interface

func New

func New(options ...func(recorder.Constructor) error) (*Recorder, error)

New returns an error if it can't create the index It returns and error on the following occasions:

+-------------------+-----------------------+
|     Condition     |         Error         |
+-------------------+-----------------------+
| Invalid endpoint  | InvalidEndpointError  |
| backoff < 5       | LowBackoffValueError  |
| Empty name        | ErrEmptyName          |
| Invalid IndexName | InvalidIndexNameError |
| Empty IndexName   | ErrEmptyIndexName     |
+-------------------+-----------------------+

func (*Recorder) Backoff

func (r *Recorder) Backoff() int

Backoff returns the backoff

func (*Recorder) Endpoint

func (r *Recorder) Endpoint() string

Endpoint returns the endpoint

func (*Recorder) IndexName

func (r *Recorder) IndexName() string

IndexName shows the indexName the recorder should record as

func (*Recorder) Name

func (r *Recorder) Name() string

Name shows the name identifier for this recorder

func (*Recorder) Ping

func (r *Recorder) Ping() error

Ping should ping the endpoint and report if was successful. It returns and error on the following occasions:

+----------------------+---------------------------+
|      Condition       |           Error           |
+----------------------+---------------------------+
| Unavailable endpoint | EndpointNotAvailableError |
| Ping errors          | Timeout/Ping failed       |
| Index creation       | elasticsearch's errors    |
+----------------------+---------------------------+

func (*Recorder) Record

func (r *Recorder) Record(ctx context.Context, job recorder.Job) error

Record returns an error if the endpoint responds in errors. It stops receiving jobs when the endpoint's absence has exceeded the backoff value. It returns an error if the ping is not called or the endpoint is not responding too many times.

func (*Recorder) SetBackoff

func (r *Recorder) SetBackoff(backoff int)

SetBackoff sets the backoff of the recorder

func (*Recorder) SetEndpoint

func (r *Recorder) SetEndpoint(endpoint string)

SetEndpoint sets the endpoint of the recorder

func (*Recorder) SetIndexName

func (r *Recorder) SetIndexName(indexName string)

SetIndexName sets the type name of the recorder

func (*Recorder) SetLogger

func (r *Recorder) SetLogger(log tools.FieldLogger)

SetLogger sets the log of the recorder

func (*Recorder) SetName

func (r *Recorder) SetName(name string)

SetName sets the name of the recorder

func (*Recorder) SetTimeout

func (r *Recorder) SetTimeout(timeout time.Duration)

SetTimeout sets the timeout of the recorder

func (*Recorder) Timeout

func (r *Recorder) Timeout() time.Duration

Timeout returns the time-out