pubsubio

Documentation

Overview

Package pubsubio provides access to PubSub on Dataflow streaming. Experimental.

Index

• func Read(s beam.Scope, project, topic string, opts *ReadOptions) beam.PCollection
• func Write(s beam.Scope, project, topic string, col beam.PCollection)
• type ReadOptions

Functions

func Read

func Read(s beam.Scope, project, topic string, opts *ReadOptions) beam.PCollection

Read reads an unbounded number of PubSubMessages from the given pubsub topic. It produces an unbounded PCollecton<*PubSubMessage>, if WithAttributes is set, or an unbounded PCollection<[]byte>.

func Write

func Write(s beam.Scope, project, topic string, col beam.PCollection)

Write writes PubSubMessages or bytes to the given pubsub topic.

Types

type ReadOptions

type ReadOptions struct {
	Subscription       string
	IDAttribute        string
	TimestampAttribute string
	WithAttributes     bool
}

ReadOptions represents options for reading from PubSub.