Directories ¶
Path | Synopsis |
---|---|
Exposes the interface of the dataset importer aka converter and selecting one automatically based on what files are in the folder being imported.
|
Exposes the interface of the dataset importer aka converter and selecting one automatically based on what files are in the folder being imported. |
Implements archiving/retrieval of dataset source zip files as delivered by GDS.
|
Implements archiving/retrieval of dataset source zip files as delivered by GDS. |
File name parser and writer, allowing us to extract metadata from the strict file name conventions defined by GDS
|
File name parser and writer, allowing us to extract metadata from the strict file name conventions defined by GDS |
Implements importer triggering based on SNS queues.
|
Implements importer triggering based on SNS queues. |
Allows reading/writing last imported time for a given dataset.
|
Allows reading/writing last imported time for a given dataset. |
internal
|
|
Allows outputting (in PIXLISE protobuf dataset format) of in-memory representation of PIXL data that importer has read.
|
Allows outputting (in PIXLISE protobuf dataset format) of in-memory representation of PIXL data that importer has read. |
Click to show internal directories.
Click to hide internal directories.