job-coordinator

README

Job Coordinator

Purpose

The purpose of this project supply the foundation of creating a workflow consisting of these workers (some executed across-machines)

• [TODO] Scheduler - determine on which machine to run a job that is ready
• [DONE] Export - responsible for prepping the local files (could create a script to run locally)
• [DONE] CopyTo - copy files to remote machine that will be required for the job
• [DONE] Starter - starts the command remotely, once the job started running its job is done
• [DONE] Monitor - monitors the remote command to determine when it is done
• [DONE] CopyBack - copies the results of the job back
• [DONE] PostProcessing - process the results to determine if it succeeded/failed
• [TODO] Reporting - will probably be responsible for summarizing the post-processed results
• [TODO] Health - can monitor health of workers and create reports or send emails
• [TODO] Cleanup worker - could be responsible for cleanup up "temp export" and "remote job" folders that are done