data-import/

directory
v3.3.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: May 4, 2023 License: Apache-2.0

Directories

Path Synopsis
Exposes the interface of the dataset importer aka converter and selecting one automatically based on what files are in the folder being imported.
Exposes the interface of the dataset importer aka converter and selecting one automatically based on what files are in the folder being imported.
Implements archiving/retrieval of dataset source zip files as delivered by GDS.
Implements archiving/retrieval of dataset source zip files as delivered by GDS.
File name parser and writer, allowing us to extract metadata from the strict file name conventions defined by GDS
File name parser and writer, allowing us to extract metadata from the strict file name conventions defined by GDS
Implements importer triggering based on SNS queues.
Implements importer triggering based on SNS queues.
Allows reading/writing last imported time for a given dataset.
Allows reading/writing last imported time for a given dataset.
internal
Allows outputting (in PIXLISE protobuf dataset format) of in-memory representation of PIXL data that importer has read.
Allows outputting (in PIXLISE protobuf dataset format) of in-memory representation of PIXL data that importer has read.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL