Documentation
¶
Index ¶
- type DistributedOption
- func (o *DistributedOption) GetFlowRunner() flow.FlowRunner
- func (o *DistributedOption) SetDataCenter(dataCenter string) *DistributedOption
- func (o *DistributedOption) SetMaster(master string) *DistributedOption
- func (o *DistributedOption) WithDriverFile() *DistributedOption
- func (o *DistributedOption) WithFile(relatedFile, toFolder string) *DistributedOption
- type DistributedPlanner
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type DistributedOption ¶
type DistributedOption struct {
RequiredFiles []rsync.FileResource
Master string
DataCenter string
Rack string
TaskMemoryMB int
FlowBid float64
Module string
Host string
Port int
}
func Option ¶
func Option() *DistributedOption
func (*DistributedOption) GetFlowRunner ¶
func (o *DistributedOption) GetFlowRunner() flow.FlowRunner
func (*DistributedOption) SetDataCenter ¶
func (o *DistributedOption) SetDataCenter(dataCenter string) *DistributedOption
func (*DistributedOption) SetMaster ¶
func (o *DistributedOption) SetMaster(master string) *DistributedOption
func (*DistributedOption) WithDriverFile ¶
func (o *DistributedOption) WithDriverFile() *DistributedOption
WithDriverFile sends the current executable over
func (*DistributedOption) WithFile ¶
func (o *DistributedOption) WithFile(relatedFile, toFolder string) *DistributedOption
WithFile sends any related file over to gleam agents so the task can still access these files on gleam agents. The files are placed on the executed task's current working directory.
type DistributedPlanner ¶
type DistributedPlanner struct {
}
func Planner ¶
func Planner() *DistributedPlanner
func (*DistributedPlanner) GetFlowRunner ¶
func (o *DistributedPlanner) GetFlowRunner() flow.FlowRunner
func (*DistributedPlanner) RunFlowContext ¶
func (fcd *DistributedPlanner) RunFlowContext(fc *flow.FlowContext)
driver runs on local, controlling all tasks
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
Package agent runs on servers with computing resources, and executes tasks sent by driver.
|
Package agent runs on servers with computing resources, and executes tasks sent by driver. |
|
Package driver coordinates distributed execution.
|
Package driver coordinates distributed execution. |
|
scheduler
Schedule tasks to run on available resources assigned by master.
|
Schedule tasks to run on available resources assigned by master. |
|
Package master collects data from agents, and manage named network channels.
|
Package master collects data from agents, and manage named network channels. |
|
Package netchan creates network channels.
|
Package netchan creates network channels. |
|
Package rsync adds file server and copying client to copy files between glow driver and agent.
|
Package rsync adds file server and copying client to copy files between glow driver and agent. |
|
Disk-backed queue
|
Disk-backed queue |
Click to show internal directories.
Click to hide internal directories.