procbuiltin

Documentation

Index

• func ExtractFieldKey(config processor.Config) (processor.Interface, error)
• func ExtractFieldPayload(config processor.Config) (processor.Interface, error)
• func FilterFieldKey(config processor.Config) (processor.Interface, error)
• func FilterFieldPayload(config processor.Config) (processor.Interface, error)
• func HTTPRequest(config processor.Config) (processor.Interface, error)
• func HoistFieldKey(config processor.Config) (processor.Interface, error)
• func HoistFieldPayload(config processor.Config) (processor.Interface, error)
• func InsertFieldKey(config processor.Config) (processor.Interface, error)
• func InsertFieldPayload(config processor.Config) (processor.Interface, error)
• func MaskFieldKey(config processor.Config) (processor.Interface, error)
• func MaskFieldPayload(config processor.Config) (processor.Interface, error)
• func ReplaceFieldKey(config processor.Config) (processor.Interface, error)
• func ReplaceFieldPayload(config processor.Config) (processor.Interface, error)
• func TimestampConvertorKey(config processor.Config) (processor.Interface, error)
• func TimestampConvertorPayload(config processor.Config) (processor.Interface, error)
• func ValueToKey(config processor.Config) (processor.Interface, error)

Functions

func ExtractFieldKey

func ExtractFieldKey(config processor.Config) (processor.Interface, error)

ExtractFieldKey builds the following processor:

• If the key is raw and has a schema attached, extract the field and use it to replace the entire key.
• If the key is raw and has no schema, return an error (not supported).
• If the key is structured, extract the field and use it to replace the entire key.

func ExtractFieldPayload

func ExtractFieldPayload(config processor.Config) (processor.Interface, error)

ExtractFieldPayload builds the following processor:

• If the payload is raw and has a schema attached, extract the field and use it to replace the entire payload.
• If the payload is raw and has no schema, return an error (not supported).
• If the payload is structured, extract the field and use it to replace the entire payload.

func FilterFieldKey

func FilterFieldKey(config processor.Config) (processor.Interface, error)

func FilterFieldPayload

func FilterFieldPayload(config processor.Config) (processor.Interface, error)

func HTTPRequest

func HTTPRequest(config processor.Config) (processor.Interface, error)

HTTPRequest builds a processor that sends an HTTP request to the specified URL with the specified HTTP method (default is POST). The record payload is used as the request body and the raw response body is put into the record payload.

func HoistFieldKey

func HoistFieldKey(config processor.Config) (processor.Interface, error)

HoistFieldKey builds the following processor:

• If the key is raw and has a schema attached, wrap it using the specified field name in a struct.
• If the key is raw and has no schema, transforms it into structured data by creating a map with the hoisted field and raw data as the value.
• If the key is structured, wrap it using the specified field name in a map.

func HoistFieldPayload

func HoistFieldPayload(config processor.Config) (processor.Interface, error)

HoistFieldPayload builds the following processor:

• If the payload is raw and has a schema attached, wrap it using the specified field name in a struct.
• If the payload is raw and has no schema, transforms it into structured data by creating a map with the hoisted field and raw data as the value.
• If the payload is structured, wrap it using the specified field name in a map.

func InsertFieldKey

func InsertFieldKey(config processor.Config) (processor.Interface, error)

InsertFieldKey builds the following processor:

• If the key is raw and has a schema attached, insert the field(s) in the key data.
• If the key is raw and has no schema, return an error (not supported).
• If the key is structured, set the field(s) in the key data.

func InsertFieldPayload

func InsertFieldPayload(config processor.Config) (processor.Interface, error)

InsertFieldPayload builds the following processor:

• If the payload is raw and has a schema attached, insert the field(s) in the payload data.
• If the payload is raw and has no schema, return an error (not supported).
• If the payload is structured, set the field(s) in the payload data.

func MaskFieldKey

func MaskFieldKey(config processor.Config) (processor.Interface, error)

MaskFieldKey builds the following processor:

• If the key is raw and has a schema attached, replace the field with the zero value of the fields type.
• If the key is raw and has no schema, return an error (not supported).
• If the key is structured, replace the field with the zero value of the fields type.

func MaskFieldPayload

func MaskFieldPayload(config processor.Config) (processor.Interface, error)

MaskFieldPayload builds the following processor:

• If the payload is raw and has a schema attached, replace the field with the zero value of the fields type.
• If the payload is raw and has no schema, return an error (not supported).
• If the payload is structured, replace the field with the zero value of the fields type.

func ReplaceFieldKey

func ReplaceFieldKey(config processor.Config) (processor.Interface, error)

ReplaceFieldKey builds a processor which replaces a field in the key in raw data with a schema or in structured data. Raw data without a schema is not supported. The processor can be controlled by 3 variables:

• "exclude" - is a comma separated list of fields that should be excluded from the processed record ("exclude" takes precedence over "include").
• "include" - is a comma separated list of fields that should be included in the processed record.
• "rename" - is a comma separated list of pairs separated by colons, that controls the mapping of old field names to new field names.

If "include" is not configured or is empty then all fields in the record will be included by default (except if they are configured in "exclude"). If "include" is not empty, then all fields are excluded by default and only fields in "include" will be added to the processed record.

func ReplaceFieldPayload

func ReplaceFieldPayload(config processor.Config) (processor.Interface, error)

ReplaceFieldPayload builds a processor which replaces a field in the payload in raw data with a schema or in structured data. Raw data without a schema is not supported. The processor can be controlled by 3 variables:

• "exclude" - is a comma separated list of fields that should be excluded from the processed record ("exclude" takes precedence over "include").
• "include" - is a comma separated list of fields that should be included in the processed record.
• "rename" - is a comma separated list of pairs separated by colons, that controls the mapping of old field names to new field names.

If "include" is not configured or is empty then all fields in the record will be included by default (except if they are configured in "exclude"). If "include" is not empty, then all fields are excluded by default and only fields in "include" will be added to the processed record.

func TimestampConvertorKey

func TimestampConvertorKey(config processor.Config) (processor.Interface, error)

TimestampConvertorKey todo

func TimestampConvertorPayload

func TimestampConvertorPayload(config processor.Config) (processor.Interface, error)

TimestampConvertorPayload todo

func ValueToKey

func ValueToKey(config processor.Config) (processor.Interface, error)

ValueToKey builds a processor that replaces the record key with a new key formed from a subset of fields in the record value.

• If the payload is raw and has a schema attached, the created key will also have a schema with a subset of fields.
• If the payload is structured, the created key will also be structured with a subset of fields.
• If the payload is raw and has no schema, return an error.