regression

package
v3.0.0-...-7ba4d6b Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jul 17, 2024 License: Apache-2.0, BSD-3-Clause, MIT Imports: 8 Imported by: 0

Documentation

Overview

Package regression contains pipeline regression tests.

Index

Constants

View Source
const (
	// MetricNamespace is the namespace for regression test metrics.
	MetricNamespace = string("regression")
	// FruitCounterName is the name of the fruit counter metric.
	FruitCounterName = string("fruitCount")
)

Variables

This section is empty.

Functions

func DirectParDo

func DirectParDo() *beam.Pipeline

DirectParDo tests direct form output DoFns.

func DirectParDoAfterGBK

func DirectParDoAfterGBK() *beam.Pipeline

DirectParDoAfterGBK generates a pipeline with a direct-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func EmitParDo

func EmitParDo() *beam.Pipeline

EmitParDo tests emit form output DoFns.

func EmitParDoAfterGBK

func EmitParDoAfterGBK() *beam.Pipeline

EmitParDoAfterGBK generates a pipeline with a emit-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func LPErrorPipeline

func LPErrorPipeline(s beam.Scope) beam.PCollection

LPErrorPipeline constructs a pipeline that has a GBK followed by a CoGBK using the same input, with schema encoded structs as elements. This ends up having the stage after the CoGBK fail since the decoder post-cogbk is missing a Length Prefix coder that was applied to the GBK input, but not the CoGBK output. Root is likely in that there's no Beam standard CoGBK format for inject and expand. JIRA: BEAM-12438

func LPErrorReshufflePipeline

func LPErrorReshufflePipeline(s beam.Scope) beam.PCollection

LPErrorReshufflePipeline checks a Row type with reshuffle transforms. It's intentionally just a prefix with validation done in the specific test cases, as the success/failure is dependent on subsequent pipeline use of data.

This pipeline will output a pcollection containing 3 fruit.

func MixedOutputParDo

func MixedOutputParDo() *beam.Pipeline

MixedOutputParDo tests mixed direct + emit form output DoFns.

func MultiEmitParDo

func MultiEmitParDo() *beam.Pipeline

MultiEmitParDo tests double emit form output DoFns.

Types

This section is empty.

Directories

Path Synopsis
coders
fromyaml
fromyaml generates a resource file from the standard_coders.yaml file for use in these coder regression tests.
fromyaml generates a resource file from the standard_coders.yaml file for use in these coder regression tests.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL