Documentation
¶
Index ¶
- func AddFakeImpulses(p *pipepb.Pipeline)
- func AddNamespace(t *pipepb.PTransform, c *pipepb.Components, namespace string)
- func Expand(ctx context.Context, req *jobpb.ExpansionRequest, expansionAddr string) (*jobpb.ExpansionResponse, error)
- func MergeExpandedWithPipeline(edges []*graph.MultiEdge, p *pipepb.Pipeline)
- func PurgeOutputInput(edges []*graph.MultiEdge, p *pipepb.Pipeline)
- func RemoveFakeImpulses(c *pipepb.Components, ext *pipepb.PTransform)
- func ResolveArtifacts(ctx context.Context, edges []*graph.MultiEdge, p *pipepb.Pipeline)
- func ResolveOutputIsBounded(e *graph.MultiEdge, isBoundedUpdater func(*graph.Node, bool))
- func VerifyNamedOutputs(ext *graph.ExternalTransform)
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func AddFakeImpulses ¶
AddFakeImpulses adds an impulse transform as the producer for each input to the root transform. Inputs need producers to form a correct pipeline.
func AddNamespace ¶
func AddNamespace(t *pipepb.PTransform, c *pipepb.Components, namespace string)
func Expand ¶
func Expand(ctx context.Context, req *jobpb.ExpansionRequest, expansionAddr string) (*jobpb.ExpansionResponse, error)
Expand queries the expansion service to resolve the ExpansionRequest
func MergeExpandedWithPipeline ¶
MergeExpandedWithPipeline adds expanded components of all ExternalTransforms to the exisiting pipeline
func PurgeOutputInput ¶
PurgeOutputInput remaps outputs from edge corresponding to an ExternalTransform with the correct expanded outputs. All consumers of the previous outputs are updated with new inputs.
func RemoveFakeImpulses ¶
func RemoveFakeImpulses(c *pipepb.Components, ext *pipepb.PTransform)
RemoveFakeImpulses removes each fake impulse per input to the the transform. Multiple producers for one Input cannot be present.
func ResolveArtifacts ¶
ResolveArtifacts acquires all dependencies for a cross-language transform
func ResolveOutputIsBounded ¶
ResolveOutputIsBounded updates each Output node with respect to the received expanded components to reflect if it is bounded or not
func VerifyNamedOutputs ¶
func VerifyNamedOutputs(ext *graph.ExternalTransform)
VerifyNamedOutputs ensures the expanded outputs correspond to the correct and expected named outputs
Types ¶
This section is empty.
Source Files