README
¶
AIStore extensions
| Name | Folder | Documentation |
|---|---|---|
| ETL | ext/etl | docs/etl.md |
| Dsort (Distributed Shuffle) | ext/dsort | docs/dsort.md |
| Downloader | ext/dload | docs/downloader.md |
Directories
¶
| Path | Synopsis |
|---|---|
|
Package dload implements functionality to download resources into AIS cluster from external source.
|
Package dload implements functionality to download resources into AIS cluster from external source. |
|
Package dsort provides distributed massively parallel resharding for very large datasets.
|
Package dsort provides distributed massively parallel resharding for very large datasets. |
|
ct
Package ct provides additional dsort-specific content types
|
Package ct provides additional dsort-specific content types |
|
shard
Package shard provides Extract(shard), Create(shard), and associated methods across all suppported archival formats (see cmn/archive/mime.go)
|
Package shard provides Extract(shard), Create(shard), and associated methods across all suppported archival formats (see cmn/archive/mime.go) |
|
Package etl provides utilities to initialize and use transformation pods.
|
Package etl provides utilities to initialize and use transformation pods. |
|
runtime
Package runtime provides skeletons and static specifications for building ETL from scratch.
|
Package runtime provides skeletons and static specifications for building ETL from scratch. |
Click to show internal directories.
Click to hide internal directories.