examples/

directory
v2.0.0-...-3952df4 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 24, 2024 License: Apache-2.0, BSD-3-Clause, MIT

Directories

Path Synopsis
complete
cookbook
max
tornadoes
tornadoes is an example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.
tornadoes is an example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.
debugging_wordcount is an example that verifies word counts in Shakespeare and includes Beam best practices.
debugging_wordcount is an example that verifies word counts in Shakespeare and includes Beam best practices.
fhirio
import
import is a pipeline example using the fhirio connector to bulk import FHIR resources from GCS into a given FHIR store.
import is a pipeline example using the fhirio connector to bulk import FHIR resources from GCS into a given FHIR store.
read_write_pubsub
read_write_pubsub is a pipeline example using the fhirio connector to read FHIR resources from GCS, write them to a GCP FHIR store, and, if a PubSub topic is provided, read the written resources from the FHIR store and log them based on the PubSub notifications about store updates.
read_write_pubsub is a pipeline example using the fhirio connector to read FHIR resources from GCS, write them to a GCP FHIR store, and, if a PubSub topic is provided, read the written resources from the FHIR store and log them based on the PubSub notifications about store updates.
forest is an example that shows that pipeline construction is normal Go code -- the pipeline "forest" is created recursively and uses a global variable -- and that a pipeline may contain non-connected parts.
forest is an example that shows that pipeline construction is normal Go code -- the pipeline "forest" is created recursively and uses a global variable -- and that a pipeline may contain non-connected parts.
taxi is an example using a cross-language Kafka pipeline to write and read to Kafka.
taxi is an example using a cross-language Kafka pipeline to write and read to Kafka.
large_wordcount is an example that demonstrates a more complex version of a wordcount pipeline.
large_wordcount is an example that demonstrates a more complex version of a wordcount pipeline.
minimal_wordcount is an example that counts words in King Lear, by William Shakespeare.
minimal_wordcount is an example that counts words in King Lear, by William Shakespeare.
multiout is a wordcount variation that uses a multi-outout DoFn and writes 2 output files.
multiout is a wordcount variation that uses a multi-outout DoFn and writes 2 output files.
native_wordcap is a toy streaming pipeline that uses PubSub.
native_wordcap is a toy streaming pipeline that uses PubSub.
nativepubsubio
Package nativepubsubio contains a Golang implementation of streaming reads and writes to PubSub.
Package nativepubsubio contains a Golang implementation of streaming reads and writes to PubSub.
readavro is a simple Avro read/write Example This example uses a 500 Byte sample avro file [twitter.avro] download here: https://s3-eu-west-1.amazonaws.com/daidokoro-dev/apache/twitter.avro
readavro is a simple Avro read/write Example This example uses a 500 Byte sample avro file [twitter.avro] download here: https://s3-eu-west-1.amazonaws.com/daidokoro-dev/apache/twitter.avro
slowly_updating_side_input is an example pipeline demonstrating the pattern described at https://beam.apache.org/documentation/patterns/side-inputs/.
slowly_updating_side_input is an example pipeline demonstrating the pattern described at https://beam.apache.org/documentation/patterns/side-inputs/.
Package snippets contains code used in the Beam Programming Guide as examples for the Apache Beam Go SDK.
Package snippets contains code used in the Beam Programming Guide as examples for the Apache Beam Go SDK.
streaming_wordcap is a toy streaming pipeline that uses PubSub.
streaming_wordcap is a toy streaming pipeline that uses PubSub.
An example of using a Splittable DoFn in the Go SDK with a portable runner.
An example of using a Splittable DoFn in the Go SDK with a portable runner.
timer_wordcap is a toy streaming pipeline that demonstrates the use of State and Timers.
timer_wordcap is a toy streaming pipeline that demonstrates the use of State and Timers.
wasm is a simple example that loads and executes a wasm file function.
wasm is a simple example that loads and executes a wasm file function.
windowed_wordcount counts words in text, and can run over either unbounded or bounded input collections.
windowed_wordcount counts words in text, and can run over either unbounded or bounded input collections.
wordcount is an example that counts words in Shakespeare and demonstrates Beam best practices.
wordcount is an example that counts words in Shakespeare and demonstrates Beam best practices.
Package xlang contains functionality for testing cross-language transforms.
Package xlang contains functionality for testing cross-language transforms.
bigquery
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
cogroup_by
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
combine
combine exemplifies using a cross-language combine per key transform from a test expansion service.
combine exemplifies using a cross-language combine per key transform from a test expansion service.
combine_globally
combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
group_by
group_by exemplifies using a cross-language group by key transform from a test expansion service.
group_by exemplifies using a cross-language group by key transform from a test expansion service.
multi_input_output
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
partition
partition exemplifies using a cross-language partition transform from a test expansion service.
partition exemplifies using a cross-language partition transform from a test expansion service.
sql
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
wordcount
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.
wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.
yatzy is an implementation of https://en.wikipedia.org/wiki/Yatzy that shows that pipeline construction is normal Go code.
yatzy is an implementation of https://en.wikipedia.org/wiki/Yatzy that shows that pipeline construction is normal Go code.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL