dynamic

Documentation

Index

• func New(underlying TaskNodeHandler, nodeExecutor executors.Node, scope promutils.Scope) handler.Node
• type ContextualWorkflowStatus
  • func (w ContextualWorkflowStatus) ConstructNodeDataDir(ctx context.Context, name v1alpha1.NodeID) (storage.DataReference, error)
  • func (w ContextualWorkflowStatus) GetDataDir() v1alpha1.DataReference
• type TaskNodeHandler

Functions

func New

func New(underlying TaskNodeHandler, nodeExecutor executors.Node, scope promutils.Scope) handler.Node

Types

type ContextualWorkflowStatus

type ContextualWorkflowStatus struct {
	v1alpha1.ExecutableWorkflowStatus
	// contains filtered or unexported fields
}

A contextual workflow status to override some of the implementations.

func (ContextualWorkflowStatus) ConstructNodeDataDir

func (w ContextualWorkflowStatus) ConstructNodeDataDir(ctx context.Context, name v1alpha1.NodeID) (storage.DataReference, error)

Overrides default node data dir to work around the contractual assumption between Propeller and Futures to write all sub-node inputs into current node data directory. E.g.

if current node data dir is /wf_exec/node-1/data/
and the task ran and yielded 2 nodes, the structure will look like this:
/wf_exec/node-1/data/
                |_ inputs.pb
                |_ futures.pb
                |_ sub-node1/inputs.pb
                |_ sub-node2/inputs.pb

TODO: This is just a stop-gap until we transition the DynamicJobSpec to be a full-fledged workflow spec. TODO: this will allow us to have proper data bindings between nodes then we can stop making assumptions about data refs.

func (ContextualWorkflowStatus) GetDataDir

func (w ContextualWorkflowStatus) GetDataDir() v1alpha1.DataReference

type TaskNodeHandler

type TaskNodeHandler interface {
	handler.Node
	ValidateOutputAndCacheAdd(ctx context.Context, nodeID v1alpha1.NodeID, i io.InputReader, r io.OutputReader, outputCommitter io.OutputWriter,
		tr pluginCore.TaskReader, m catalog.Metadata) (*io.ExecutionError, error)
}