dynamic

Documentation

Index

• func New(underlying handler.IFace, nodeExecutor executors.Node, ...) handler.IFace
• type ContextualWorkflowStatus
  • func (w ContextualWorkflowStatus) ConstructNodeDataDir(ctx context.Context, constructor storage.ReferenceConstructor, ...) (storage.DataReference, error)
  • func (w ContextualWorkflowStatus) GetDataDir() v1alpha1.DataReference

Functions

func New

func New(underlying handler.IFace, nodeExecutor executors.Node, enQWorkflow v1alpha1.EnqueueWorkflow, store *storage.DataStore,
	scope promutils.Scope) handler.IFace

Types

type ContextualWorkflowStatus

type ContextualWorkflowStatus struct {
	v1alpha1.ExecutableWorkflowStatus
	// contains filtered or unexported fields
}

A contextual workflow status to override some of the implementations.

func (ContextualWorkflowStatus) ConstructNodeDataDir

func (w ContextualWorkflowStatus) ConstructNodeDataDir(ctx context.Context, constructor storage.ReferenceConstructor,
	name v1alpha1.NodeID) (storage.DataReference, error)

Overrides default node data dir to work around the contractual assumption between Propeller and Futures to write all sub-node inputs into current node data directory. E.g.

if current node data dir is /wf_exec/node-1/data/
and the task ran and yielded 2 nodes, the structure will look like this:
/wf_exec/node-1/data/
                |_ inputs.pb
                |_ futures.pb
                |_ sub-node1/inputs.pb
                |_ sub-node2/inputs.pb

TODO: This is just a stop-gap until we transition the DynamicJobSpec to be a full-fledged workflow spec. TODO: this will allow us to have proper data bindings between nodes then we can stop making assumptions about data refs.

func (ContextualWorkflowStatus) GetDataDir

func (w ContextualWorkflowStatus) GetDataDir() v1alpha1.DataReference