xlang

package
v2.0.0-...-3952df4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 24, 2024 License: Apache-2.0, BSD-3-Clause, MIT Imports: 4 Imported by: 0

Documentation

Overview

Package xlang contains functionality for testing cross-language transforms.

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func CoGroupByKey

func CoGroupByKey(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection

func CombineGlobally

func CombineGlobally(s beam.Scope, addr string, col beam.PCollection) beam.PCollection

func CombinePerKey

func CombinePerKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection

func Count

func Count(s beam.Scope, addr string, col beam.PCollection) beam.PCollection

func Flatten

func Flatten(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection

func GroupByKey

func GroupByKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection

func Multi

func Multi(s beam.Scope, addr string, main1, main2, side beam.PCollection) (mainOut, sideOut beam.PCollection)

func Partition

func Partition(s beam.Scope, addr string, col beam.PCollection) (out0, out1 beam.PCollection)

func Prefix

func Prefix(s beam.Scope, prefix string, addr string, col beam.PCollection) beam.PCollection

Prefix wraps a cross-language transform call to the Prefix transform. This transform takes a PCollection of strings as input, and a payload defining a prefix string, and appends that as prefix to each input string.

This serves as an example of a cross-language transform with a payload.

Types

This section is empty.

Directories

Path Synopsis
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
combine exemplifies using a cross-language combine per key transform from a test expansion service.
combine exemplifies using a cross-language combine per key transform from a test expansion service.
combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
group_by exemplifies using a cross-language group by key transform from a test expansion service.
group_by exemplifies using a cross-language group by key transform from a test expansion service.
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
partition exemplifies using a cross-language partition transform from a test expansion service.
partition exemplifies using a cross-language partition transform from a test expansion service.
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL