Documentation
¶
Overview ¶
Package xlang contains functionality for testing cross-language transforms.
Index ¶
- func CoGroupByKey(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection
- func CombineGlobally(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
- func CombinePerKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
- func Count(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
- func Flatten(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection
- func GroupByKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
- func Multi(s beam.Scope, addr string, main1, main2, side beam.PCollection) (mainOut, sideOut beam.PCollection)
- func Partition(s beam.Scope, addr string, col beam.PCollection) (out0, out1 beam.PCollection)
- func Prefix(s beam.Scope, prefix string, addr string, col beam.PCollection) beam.PCollection
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func CoGroupByKey ¶
func CoGroupByKey(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection
func CombineGlobally ¶
func CombineGlobally(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
func CombinePerKey ¶
func CombinePerKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
func Count ¶
func Count(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
func Flatten ¶
func Flatten(s beam.Scope, addr string, col1, col2 beam.PCollection) beam.PCollection
func GroupByKey ¶
func GroupByKey(s beam.Scope, addr string, col beam.PCollection) beam.PCollection
func Multi ¶
func Multi(s beam.Scope, addr string, main1, main2, side beam.PCollection) (mainOut, sideOut beam.PCollection)
func Partition ¶
func Partition(s beam.Scope, addr string, col beam.PCollection) (out0, out1 beam.PCollection)
func Prefix ¶
func Prefix(s beam.Scope, prefix string, addr string, col beam.PCollection) beam.PCollection
Prefix wraps a cross-language transform call to the Prefix transform. This transform takes a PCollection of strings as input, and a payload defining a prefix string, and appends that as prefix to each input string.
This serves as an example of a cross-language transform with a payload.
Types ¶
This section is empty.
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
|
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery. |
|
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
|
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service. |
|
combine exemplifies using a cross-language combine per key transform from a test expansion service.
|
combine exemplifies using a cross-language combine per key transform from a test expansion service. |
|
combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
|
combine_globally exemplifies using a cross-language combine global transform from a test expansion service. |
|
group_by exemplifies using a cross-language group by key transform from a test expansion service.
|
group_by exemplifies using a cross-language group by key transform from a test expansion service. |
|
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
|
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service. |
|
partition exemplifies using a cross-language partition transform from a test expansion service.
|
partition exemplifies using a cross-language partition transform from a test expansion service. |
|
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
|
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK. |
|
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.
|
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words. |
Click to show internal directories.
Click to hide internal directories.