examples/

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

Links

Open Source Insights

Directories ¶

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL

Path	Synopsis
complete
autocomplete
contains
cookbook
combine
filter
join
max
tornadoes tornadoes is an example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.	tornadoes is an example that reads the public samples of weather data from BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery.
debugging_wordcount debugging_wordcount is an example that verifies word counts in Shakespeare and includes Beam best practices.	debugging_wordcount is an example that verifies word counts in Shakespeare and includes Beam best practices.
fhirio
import import is a pipeline example using the fhirio connector to bulk import FHIR resources from GCS into a given FHIR store.	import is a pipeline example using the fhirio connector to bulk import FHIR resources from GCS into a given FHIR store.
read_write_pubsub read_write_pubsub is a pipeline example using the fhirio connector to read FHIR resources from GCS, write them to a GCP FHIR store, and, if a PubSub topic is provided, read the written resources from the FHIR store and log them based on the PubSub notifications about store updates.	read_write_pubsub is a pipeline example using the fhirio connector to read FHIR resources from GCS, write them to a GCP FHIR store, and, if a PubSub topic is provided, read the written resources from the FHIR store and log them based on the PubSub notifications about store updates.
forest forest is an example that shows that pipeline construction is normal Go code -- the pipeline "forest" is created recursively and uses a global variable -- and that a pipeline may contain non-connected parts.	forest is an example that shows that pipeline construction is normal Go code -- the pipeline "forest" is created recursively and uses a global variable -- and that a pipeline may contain non-connected parts.
grades
kafka taxi is an example using a cross-language Kafka pipeline to write and read to Kafka.	taxi is an example using a cross-language Kafka pipeline to write and read to Kafka.
large_wordcount large_wordcount is an example that demonstrates a more complex version of a wordcount pipeline.	large_wordcount is an example that demonstrates a more complex version of a wordcount pipeline.
minimal_wordcount minimal_wordcount is an example that counts words in King Lear, by William Shakespeare.	minimal_wordcount is an example that counts words in King Lear, by William Shakespeare.
multiout multiout is a wordcount variation that uses a multi-outout DoFn and writes 2 output files.	multiout is a wordcount variation that uses a multi-outout DoFn and writes 2 output files.
native_wordcap native_wordcap is a toy streaming pipeline that uses PubSub.	native_wordcap is a toy streaming pipeline that uses PubSub.
nativepubsubio Package nativepubsubio contains a Golang implementation of streaming reads and writes to PubSub.	Package nativepubsubio contains a Golang implementation of streaming reads and writes to PubSub.
pingpong
readavro readavro is a simple Avro read/write Example This example uses a 500 Byte sample avro file [twitter.avro] download here: https://s3-eu-west-1.amazonaws.com/daidokoro-dev/apache/twitter.avro	readavro is a simple Avro read/write Example This example uses a 500 Byte sample avro file [twitter.avro] download here: https://s3-eu-west-1.amazonaws.com/daidokoro-dev/apache/twitter.avro
slowly_updating_side_input slowly_updating_side_input is an example pipeline demonstrating the pattern described at https://beam.apache.org/documentation/patterns/side-inputs/.	slowly_updating_side_input is an example pipeline demonstrating the pattern described at https://beam.apache.org/documentation/patterns/side-inputs/.
snippets Package snippets contains code used in the Beam Programming Guide as examples for the Apache Beam Go SDK.	Package snippets contains code used in the Beam Programming Guide as examples for the Apache Beam Go SDK.
streaming_wordcap streaming_wordcap is a toy streaming pipeline that uses PubSub.	streaming_wordcap is a toy streaming pipeline that uses PubSub.
stringsplit An example of using a Splittable DoFn in the Go SDK with a portable runner.	An example of using a Splittable DoFn in the Go SDK with a portable runner.
timer_wordcap timer_wordcap is a toy streaming pipeline that demonstrates the use of State and Timers.	timer_wordcap is a toy streaming pipeline that demonstrates the use of State and Timers.
wasm wasm is a simple example that loads and executes a wasm file function.	wasm is a simple example that loads and executes a wasm file function.
windowed_wordcount windowed_wordcount counts words in text, and can run over either unbounded or bounded input collections.	windowed_wordcount counts words in text, and can run over either unbounded or bounded input collections.
wordcount wordcount is an example that counts words in Shakespeare and demonstrates Beam best practices.	wordcount is an example that counts words in Shakespeare and demonstrates Beam best practices.
xlang Package xlang contains functionality for testing cross-language transforms.	Package xlang contains functionality for testing cross-language transforms.
bigquery Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.	Wordcount is an example using cross-language BigQuery transforms to read and write to BigQuery.
cogroup_by cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.	cogroup_by exemplifies using a cross-language cogroup by key transform from a test expansion service.
combine combine exemplifies using a cross-language combine per key transform from a test expansion service.	combine exemplifies using a cross-language combine per key transform from a test expansion service.
combine_globally combine_globally exemplifies using a cross-language combine global transform from a test expansion service.	combine_globally exemplifies using a cross-language combine global transform from a test expansion service.
flatten
group_by group_by exemplifies using a cross-language group by key transform from a test expansion service.	group_by exemplifies using a cross-language group by key transform from a test expansion service.
multi_input_output multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.	multi exemplifies using a cross-language transform with multiple inputs and outputs from a test expansion service.
partition partition exemplifies using a cross-language partition transform from a test expansion service.	partition exemplifies using a cross-language partition transform from a test expansion service.
sql Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.	Prerequisites to run sql: –> [Required] Job needs to be submitted to a portable runner (--runner=universal) –> [Required] Endpoint of job service needs to be passed (--endpoint=<ip:port>) –> [Required] Endpoint of expansion service needs to be passed (--expansion_addr=<ip:port>) –> [Optional] Environment type can be LOOPBACK.
wordcount wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.	wordcount exemplifies using a cross-language Count transform from a test expansion service to count words.
yatzy yatzy is an implementation of https://en.wikipedia.org/wiki/Yatzy that shows that pipeline construction is normal Go code.	yatzy is an implementation of https://en.wikipedia.org/wiki/Yatzy that shows that pipeline construction is normal Go code.