presto

README

presto

Usage

source:
  name: presto
  config:
    connection_url: http://user:pass@localhost:8080
    exclude_catalog: memory,system

Inputs

Key	Value	Example	Description
connection_url	string	http://user:pass@localhost:8080	URL to access the presto server	required
exclude_catalog	string	memory,system	This is a comma separated catalog list to exclude from querying data	optional

Outputs

Field	Sample Value
resource.urn	my_catalog.my_database.my_table
resource.name	my_table
resource.service	presto
schema	[]Column

Column

Field	Sample Value
name	total_price
data_type	decimal
is_nullable	true
description	item's total price

Contributing

Refer to the contribution guidelines for information on contributing to this module.

Documentation

Index

• type Config
• type Extractor
  • func New(logger log.Logger) *Extractor
  • func (e *Extractor) Extract(ctx context.Context, emit plugins.Emit) error
  • func (e *Extractor) Init(ctx context.Context, config plugins.Config) (err error)

Types

type Config

type Config struct {
	ConnectionURL string `mapstructure:"connection_url" validate:"required"`
	Exclude       string `mapstructure:"exclude_catalog"`
}

Config holds the set of configuration options for the extractor

type Extractor

type Extractor struct {
	plugins.BaseExtractor
	// contains filtered or unexported fields
}

Extractor manages the extraction of data

func New

func New(logger log.Logger) *Extractor

New returns a pointer to an initialized Extractor Object

func (*Extractor) Extract

func (e *Extractor) Extract(ctx context.Context, emit plugins.Emit) error

Extract collects metadata of the database through emitter

func (*Extractor) Init

func (e *Extractor) Init(ctx context.Context, config plugins.Config) (err error)

Init initializes the extractor