README
¶
pusher
Push data from nodes to cloud storage. This is meant to be a sidecar service for experiments deployed on M-Lab. Experiments write data to a particular directory and this system watches that directory and tars, compresses, and uploads the data files.
Available as a container in measurementlab/pusher on Docker Hub.
Documentation
¶
There is no documentation for this package.
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
Package backoff provides a tool for repeatedly calling a function until it returns a nil error.
|
Package backoff provides a tool for repeatedly calling a function until it returns a nil error. |
|
Package filename provides types for representing files on disk and files inside of tarfiles.
|
Package filename provides types for representing files on disk and files inside of tarfiles. |
|
Package finder provides a `find`-like interface to file discovery.
|
Package finder provides a `find`-like interface to file discovery. |
|
Package listener provides an interface to an inotify-based system for watching a directory and its subdirectories for file close and file move events.
|
Package listener provides an interface to an inotify-based system for watching a directory and its subdirectories for file close and file move events. |
|
Package namer provides a tool for creating archival filenames from a timestamp.
|
Package namer provides a tool for creating archival filenames from a timestamp. |
|
Package tarcache supports the creation and running of a pipeline that receives files, tars up the contents, and uploads everything when the tarfile is big enough or the contents are old enough.
|
Package tarcache supports the creation and running of a pipeline that receives files, tars up the contents, and uploads everything when the tarfile is big enough or the contents are old enough. |
|
Package uploader provides a tool for saving byte buffers to Google Cloud Storage.
|
Package uploader provides a tool for saving byte buffers to Google Cloud Storage. |
Click to show internal directories.
Click to hide internal directories.