ingestor

Documentation

Overview

Package ingestor defines the interface that collects data from different sources.

Index

• type Default
  • func (d Default) Ingest(ctx context.Context, out chan<- api.Domain, sources ...datasource.Datasource) error
• type Ingestor

Types

type Default

type Default struct{}

Default ingestor calls all datasources (one goroutine for each source) and reports results through domains channel.

Default ingestor doesn't give priority to any source.

func (Default) Ingest

func (d Default) Ingest(ctx context.Context, out chan<- api.Domain, sources ...datasource.Datasource) error

Ingest collects domains from all datasources and reports them. It might report duplicate domains.

type Ingestor

type Ingestor interface {
	// Ingest collects domains from datasources and reports them.
	Ingest(context.Context, chan<- api.Domain, ...datasource.Datasource) error
}

Ingestor collects data from the given source.