csv

README

csv

Usage

source:
  name: csv
  config:
    path: ./path-to-a-file-or-a-directory

Inputs

Key	Value	Example	Description
path	string	./folder/filename.csv	Path to a file or a directory	required

Notes

Passing directory in path will collect and extract metadata from all .csv files directly inside the directory path.

Outputs

Field	Sample Value
resource.urn	filename.csv
resource.name	filename.csv
resource.service	csv
schema.columns	[]Column

Column

Field	Sample Value	Description
name	order_id	csv header e.g. first row

Contributing

Refer to the contribution guidelines for information on contributing to this module.

Documentation

Index

• type Config
• type Extractor
  • func New(logger log.Logger) *Extractor
  • func (e *Extractor) Extract(_ context.Context, emit plugins.Emit) error
  • func (e *Extractor) Init(ctx context.Context, config plugins.Config) error

Types

type Config

type Config struct {
	Path string `mapstructure:"path" validate:"required"`
}

Config holds the path configuration for the csv extractor

type Extractor

type Extractor struct {
	plugins.BaseExtractor
	// contains filtered or unexported fields
}

Extractor manages the extraction of data from the extractor

func New

func New(logger log.Logger) *Extractor

New returns a pointer to an initialized Extractor Object

func (*Extractor) Extract

func (e *Extractor) Extract(_ context.Context, emit plugins.Emit) error

Extract checks if the extractor is configured and returns the extracted data

func (*Extractor) Init

func (e *Extractor) Init(ctx context.Context, config plugins.Config) error