geist-connector-bigquery

README

GEIST BigQuery Connector

Geist BigQuery Connector enables BigQuery as a sink type in stream specs when using Geist.

Note that this connector previously resided in the geist-connector-gcp repo, but was moved out to its own for improved maintainability and ease of use.

Usage

See GEIST core repo for general information.

Install with:

go get github.com/zpiroux/geist-connector-bigquery

Geist Integration

Register connector prior to starting up Geist with (error handling omitted):

import (
	"github.com/zpiroux/geist"
	"github.com/zpiroux/geist-connector-bigquery/gbigquery"
)

...
geistConfig := geist.NewConfig()

bqConfig := &gbigquery.Config{ /* add config */ }

err = geistConfig.RegisterExtractorType(gbigquery.NewExtractorFactory(bqConfig))
err = geistConfig.RegisterLoaderType(gbigquery.NewLoaderFactory(bqConfig))

g, err := geist.New(ctx, geistConfig)
...

Stream Spec Configuration

For now, see stream spec examples here and here.

Contact

info @ zpiroux . com

License

Geist BigQuery Connector source code is available under the MIT License.