Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Datamart ¶
type Datamart struct {
// contains filtered or unexported fields
}
Datamart can be used to import datasets from datamarts. Note that all the work is done by the datamart metadata storage so this is empty.
func (*Datamart) CleanupImport ¶
func (d *Datamart) CleanupImport(ingestResult *task.IngestResult) error
CleanupImport removes temporary files and structures created during the import.
func (*Datamart) Initialize ¶
func (d *Datamart) Initialize(params map[string]interface{}, ingestParams *task.IngestParams) error
Initialize sets up the importer.
func (*Datamart) PrepareImport ¶
func (d *Datamart) PrepareImport() (*task.IngestSteps, *task.IngestParams, error)
PrepareImport prepares the datamart dataset for import.
type Importer ¶
type Importer interface {
Initialize(params map[string]interface{}, ingestParams *task.IngestParams) error
PrepareImport() (*task.IngestSteps, *task.IngestParams, error)
CleanupImport(ingestResult *task.IngestResult) error
}
Importer can be used to import datasets into the system.
func NewDatamart ¶
func NewDatamart() Importer
NewDatamart creates an importer for datamart datasets.
func NewJoined ¶
func NewJoined(meta api.MetadataStorage, config *env.Config) Importer
NewJoined creates a new importer for joined datasets.
type Joined ¶
type Joined struct {
// contains filtered or unexported fields
}
Joined can be used to import datasets that have been joined.
func (*Joined) CleanupImport ¶
func (j *Joined) CleanupImport(ingestResult *task.IngestResult) error
CleanupImport removes temporary files and structures created during the import.
func (*Joined) Initialize ¶
func (j *Joined) Initialize(params map[string]interface{}, ingestParams *task.IngestParams) error
Initialize sets up the importer.
func (*Joined) PrepareImport ¶
func (j *Joined) PrepareImport() (*task.IngestSteps, *task.IngestParams, error)
PrepareImport prepares the dataset for import.
type Local ¶
type Local struct {
// contains filtered or unexported fields
}
Local can be used to import datasets from the local filesystem.
func (*Local) CleanupImport ¶
func (l *Local) CleanupImport(ingestResult *task.IngestResult) error
CleanupImport removes temporary files and structures created during the import.
func (*Local) Initialize ¶
func (l *Local) Initialize(params map[string]interface{}, ingestParams *task.IngestParams) error
Initialize sets up the importer.
func (*Local) PrepareImport ¶
func (l *Local) PrepareImport() (*task.IngestSteps, *task.IngestParams, error)
PrepareImport prepares the dataset for import.
type Union ¶
type Union struct {
// contains filtered or unexported fields
}
Union can be used to import datasets that have been combined using the union operation.
func (*Union) CleanupImport ¶
func (u *Union) CleanupImport(ingestResult *task.IngestResult) error
CleanupImport removes temporary files and structures created during the import.
func (*Union) Initialize ¶
func (u *Union) Initialize(params map[string]interface{}, ingestParams *task.IngestParams) error
Initialize sets up the importer.
func (*Union) PrepareImport ¶
func (u *Union) PrepareImport() (*task.IngestSteps, *task.IngestParams, error)
PrepareImport prepares the dataset for import.
Source Files