gardener

README

Gardener provides both a service for reprocessing and deduplicating, and will (soon) provide a command line tool for doing manual reprocessing and deduplicating operations.

The command line should be run from an environment logged into gcloud in the appropriate project.

For example:

go run cmd/gardener/gardener.go -project mlab-oti -day 2017/10/01

The batch pipeline job also runs in and writes to mlab-oti.

Documentation

Overview

Package main defines a service for handling various post-processing and house-keeping tasks associated with the pipelines. Most tasks will be run periodically, but some may be triggered by URL requests from authorized sources.