v1beta1

package
v1.122.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 10, 2024 License: Apache-2.0 Imports: 6 Imported by: 0

Documentation

Overview

+kcc:proto=google.dataflow.v1beta3

+kubebuilder:object:generate=true +groupName=dataflow.cnrm.cloud.google.com

Index

Constants

This section is empty.

Variables

View Source 
var (
	// GroupVersion is group version used to register these objects
	GroupVersion = schema.GroupVersion{Group: "dataflow.cnrm.cloud.google.com", Version: "v1beta1"}

	// SchemeBuilder is used to add go types to the GroupVersionKind scheme
	SchemeBuilder = &scheme.Builder{GroupVersion: GroupVersion}

	// AddToScheme adds the types in this group-version to the given scheme.
	AddToScheme = SchemeBuilder.AddToScheme
)
View Source 
var DataflowFlexTemplateJobGVK = GroupVersion.WithKind("DataflowFlexTemplateJob")

Functions

This section is empty.

Types

type AutoscalingEvent 

type AutoscalingEvent struct {
	// The current number of workers the job has.
	CurrentNumWorkers *int64 `json:"currentNumWorkers,omitempty"`

	// The target number of workers the worker pool wants to resize to use.
	TargetNumWorkers *int64 `json:"targetNumWorkers,omitempty"`

	// The type of autoscaling event to report.
	EventType *string `json:"eventType,omitempty"`

	// A message describing why the system decided to adjust the current
	//  number of workers, why it failed, or why the system decided to
	//  not make any changes to the number of workers.
	Description *StructuredMessage `json:"description,omitempty"`

	// The time this event was emitted to indicate a new target or current
	//  num_workers value.
	Time *string `json:"time,omitempty"`

	// A short and friendly name for the worker pool this event refers to.
	WorkerPool *string `json:"workerPool,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.AutoscalingEvent

func (*AutoscalingEvent) DeepCopy 

func (in *AutoscalingEvent) DeepCopy() *AutoscalingEvent

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new AutoscalingEvent.

func (*AutoscalingEvent) DeepCopyInto 

func (in *AutoscalingEvent) DeepCopyInto(out *AutoscalingEvent)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type AutoscalingSettings 

type AutoscalingSettings struct {
	// The algorithm to use for autoscaling.
	Algorithm *string `json:"algorithm,omitempty"`

	// The maximum number of workers to cap scaling at.
	MaxNumWorkers *int32 `json:"maxNumWorkers,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.AutoscalingSettings

func (*AutoscalingSettings) DeepCopy 

func (in *AutoscalingSettings) DeepCopy() *AutoscalingSettings

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new AutoscalingSettings.

func (*AutoscalingSettings) DeepCopyInto 

func (in *AutoscalingSettings) DeepCopyInto(out *AutoscalingSettings)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type BigQueryIODetails 

type BigQueryIODetails struct {
	// Table accessed in the connection.
	Table *string `json:"table,omitempty"`

	// Dataset accessed in the connection.
	Dataset *string `json:"dataset,omitempty"`

	// Project accessed in the connection.
	ProjectID *string `json:"projectID,omitempty"`

	// Query used to access data in the connection.
	Query *string `json:"query,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.BigQueryIODetails

func (*BigQueryIODetails) DeepCopy 

func (in *BigQueryIODetails) DeepCopy() *BigQueryIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new BigQueryIODetails.

func (*BigQueryIODetails) DeepCopyInto 

func (in *BigQueryIODetails) DeepCopyInto(out *BigQueryIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type BigTableIODetails 

type BigTableIODetails struct {
	// ProjectId accessed in the connection.
	ProjectID *string `json:"projectID,omitempty"`

	// InstanceId accessed in the connection.
	InstanceID *string `json:"instanceID,omitempty"`

	// TableId accessed in the connection.
	TableID *string `json:"tableID,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.BigTableIODetails

func (*BigTableIODetails) DeepCopy 

func (in *BigTableIODetails) DeepCopy() *BigTableIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new BigTableIODetails.

func (*BigTableIODetails) DeepCopyInto 

func (in *BigTableIODetails) DeepCopyInto(out *BigTableIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ComputationTopology 

type ComputationTopology struct {
	// The system stage name.
	SystemStageName *string `json:"systemStageName,omitempty"`

	// The ID of the computation.
	ComputationID *string `json:"computationID,omitempty"`

	// The key ranges processed by the computation.
	KeyRanges []KeyRangeLocation `json:"keyRanges,omitempty"`

	// The inputs to the computation.
	Inputs []StreamLocation `json:"inputs,omitempty"`

	// The outputs from the computation.
	Outputs []StreamLocation `json:"outputs,omitempty"`

	// The state family values.
	StateFamilies []StateFamilyConfig `json:"stateFamilies,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ComputationTopology

func (*ComputationTopology) DeepCopy 

func (in *ComputationTopology) DeepCopy() *ComputationTopology

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ComputationTopology.

func (*ComputationTopology) DeepCopyInto 

func (in *ComputationTopology) DeepCopyInto(out *ComputationTopology)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ContainerSpec 

type ContainerSpec struct {
	// Name of the docker container image. E.g., gcr.io/project/some-image
	Image *string `json:"image,omitempty"`

	// Metadata describing a template including description and validation rules.
	Metadata *TemplateMetadata `json:"metadata,omitempty"`

	// Required. SDK info of the Flex Template.
	SdkInfo *SDKInfo `json:"sdkInfo,omitempty"`

	// Default runtime environment for the job.
	DefaultEnvironment *FlexTemplateRuntimeEnvironment `json:"defaultEnvironment,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ContainerSpec

func (*ContainerSpec) DeepCopy 

func (in *ContainerSpec) DeepCopy() *ContainerSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ContainerSpec.

func (*ContainerSpec) DeepCopyInto 

func (in *ContainerSpec) DeepCopyInto(out *ContainerSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type CustomSourceLocation 

type CustomSourceLocation struct {
	// Whether this source is stateful.
	Stateful *bool `json:"stateful,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.CustomSourceLocation

func (*CustomSourceLocation) DeepCopy 

func (in *CustomSourceLocation) DeepCopy() *CustomSourceLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new CustomSourceLocation.

func (*CustomSourceLocation) DeepCopyInto 

func (in *CustomSourceLocation) DeepCopyInto(out *CustomSourceLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataDiskAssignment 

type DataDiskAssignment struct {
	// VM instance name the data disks mounted to, for example
	//  "myproject-1014-104817-4c2-harness-0".
	VmInstance *string `json:"vmInstance,omitempty"`

	// Mounted data disks. The order is important a data disk's 0-based index in
	//  this list defines which persistent directory the disk is mounted to, for
	//  example the list of { "myproject-1014-104817-4c2-harness-0-disk-0" },
	//  { "myproject-1014-104817-4c2-harness-0-disk-1" }.
	DataDisks []string `json:"dataDisks,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.DataDiskAssignment

func (*DataDiskAssignment) DeepCopy 

func (in *DataDiskAssignment) DeepCopy() *DataDiskAssignment

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataDiskAssignment.

func (*DataDiskAssignment) DeepCopyInto 

func (in *DataDiskAssignment) DeepCopyInto(out *DataDiskAssignment)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowFlexTemplateJob 

type DataflowFlexTemplateJob struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	// +required
	Spec DataflowFlexTemplateJobSpec `json:"spec,omitempty"`

	Status DataflowFlexTemplateJobStatus `json:"status,omitempty"`
}

DataflowFlexTemplateJob is the Schema for the DataflowFlexTemplateJob API +k8s:openapi-gen=true

func (*DataflowFlexTemplateJob) DeepCopy 

func (in *DataflowFlexTemplateJob) DeepCopy() *DataflowFlexTemplateJob

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJob.

func (*DataflowFlexTemplateJob) DeepCopyInto 

func (in *DataflowFlexTemplateJob) DeepCopyInto(out *DataflowFlexTemplateJob)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowFlexTemplateJob) DeepCopyObject 

func (in *DataflowFlexTemplateJob) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowFlexTemplateJobList 

type DataflowFlexTemplateJobList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []DataflowFlexTemplateJob `json:"items"`
}

+k8s:deepcopy-gen:interfaces=k8s.io/apimachinery/pkg/runtime.Object DataflowFlexTemplateJobList contains a list of DataflowFlexTemplateJob

func (*DataflowFlexTemplateJobList) DeepCopy 

func (in *DataflowFlexTemplateJobList) DeepCopy() *DataflowFlexTemplateJobList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobList.

func (*DataflowFlexTemplateJobList) DeepCopyInto 

func (in *DataflowFlexTemplateJobList) DeepCopyInto(out *DataflowFlexTemplateJobList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowFlexTemplateJobList) DeepCopyObject 

func (in *DataflowFlexTemplateJobList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowFlexTemplateJobObservedState 

type DataflowFlexTemplateJobObservedState struct {
}

DataflowFlexTemplateJobSpec defines the desired state of DataflowFlexTemplateJob

func (*DataflowFlexTemplateJobObservedState) DeepCopy 

func (in *DataflowFlexTemplateJobObservedState) DeepCopy() *DataflowFlexTemplateJobObservedState

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobObservedState.

func (*DataflowFlexTemplateJobObservedState) DeepCopyInto 

func (in *DataflowFlexTemplateJobObservedState) DeepCopyInto(out *DataflowFlexTemplateJobObservedState)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowFlexTemplateJobSpec 

type DataflowFlexTemplateJobSpec struct {

	// Immutable. The region in which the created job should run.
	// +optional
	Region *string `json:"region"`

	// Cloud Storage path to a file with json serialized ContainerSpec as
	//  content.
	// +required
	ContainerSpecGcsPath *string `json:"containerSpecGcsPath,omitempty"`

	// The parameters for FlexTemplate.
	//  Ex. {"num_workers":"5"}
	Parameters *runtime.RawExtension `json:"parameters,omitempty"`

	// Map of transform name prefixes of the job to be replaced
	// with the corresponding name prefixes of the new job.
	// Only applicable when updating a pipeline.
	TransformNameMapping *runtime.RawExtension `json:"transformNameMapping,omitempty"`

	// The initial number of Google Compute Engine instances for the job.
	NumWorkers *int32 `json:"numWorkers,omitempty"`

	// The maximum number of Google Compute Engine instances to be made
	//  available to your pipeline during execution, from 1 to 1000.
	MaxWorkers *int32 `json:"maxWorkers,omitempty"`

	// The email address of the service account to run the job as.
	ServiceAccountEmailRef *refs.IAMServiceAccountRef `json:"serviceAccountEmailRef,omitempty"`

	// The Cloud Storage path to use for temporary files.
	//  Must be a valid Cloud Storage URL, beginning with `gs://`.
	TempLocation *string `json:"tempLocation,omitempty"`

	// The machine type to use for the job. Defaults to the value from the
	//  template if not specified.
	MachineType *string `json:"machineType,omitempty"`

	// Additional experiment flags for the job.
	AdditionalExperiments []string `json:"additionalExperiments,omitempty"`

	// Network to which VMs will be assigned.  If empty or unspecified,
	//  the service will use the network "default".
	NetworkRef *refs.ComputeNetworkRef `json:"networkRef,omitempty"`

	// Subnetwork to which VMs will be assigned, if desired. You can specify a
	//  subnetwork using either a complete URL or an abbreviated path. Expected to
	//  be of the form
	//  "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK"
	//  or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in
	//  a Shared VPC network, you must use the complete URL.
	SubnetworkRef *refs.ComputeSubnetworkRef `json:"subnetworkRef,omitempty"`

	// The Cloud KMS key for the job.
	KmsKeyNameRef *refs.KMSCryptoKeyRef `json:"kmsKeyNameRef,omitempty"`

	// Configuration for VM IPs.
	IPConfiguration *string `json:"ipConfiguration,omitempty"`

	// Whether to enable Streaming Engine for the job.
	EnableStreamingEngine *bool `json:"enableStreamingEngine,omitempty"`

	// The Cloud Storage path for staging local files.
	//  Must be a valid Cloud Storage URL, beginning with `gs://`.
	StagingLocation *string `json:"stagingLocation,omitempty"`

	// Docker registry location of container image to use for the 'worker harness.
	//  Default is the container for the version of the SDK. Note this field is
	//  only valid for portable pipelines.
	SDKContainerImage *string `json:"sdkContainerImage,omitempty"`

	// The algorithm to use for autoscaling
	AutoscalingAlgorithm *string `json:"autoscalingAlgorithm,omitempty"`

	// The machine type to use for launching the job. The default is
	//  n1-standard-1.
	LauncherMachineType *string `json:"launcherMachineType,omitempty"`
}

DataflowFlexTemplateJobSpec defines the desired state of DataflowFlexTemplateJob +kcc:proto=google.dataflow.v1beta3.FlexTemplateRuntimeEnvironment

func (*DataflowFlexTemplateJobSpec) DeepCopy 

func (in *DataflowFlexTemplateJobSpec) DeepCopy() *DataflowFlexTemplateJobSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobSpec.

func (*DataflowFlexTemplateJobSpec) DeepCopyInto 

func (in *DataflowFlexTemplateJobSpec) DeepCopyInto(out *DataflowFlexTemplateJobSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowFlexTemplateJobStatus 

type DataflowFlexTemplateJobStatus struct {
	/* Conditions represent the latest available observations of the
	   object's current state. */
	Conditions []v1alpha1.Condition `json:"conditions,omitempty"`

	// ObservedGeneration is the generation of the resource that was most recently observed by the Config Connector controller. If this is equal to metadata.generation, then that means that the current reported status reflects the most recent desired state of the resource.
	// +optional
	ObservedGeneration *int64 `json:"observedGeneration,omitempty"`

	JobID string `json:"jobId,omitempty"`

	// The current state of the job.
	//
	//  Jobs are created in the `JOB_STATE_STOPPED` state unless otherwise
	//  specified.
	//
	//  A job in the `JOB_STATE_RUNNING` state may asynchronously enter a
	//  terminal state. After a job has reached a terminal state, no
	//  further state updates may be made.
	//
	//  This field may be mutated by the Cloud Dataflow service;
	//  callers cannot mutate it.
	CurrentState *string `json:"state,omitempty"`

	// The type of Cloud Dataflow job.
	Type *string `json:"type,omitempty"`
}

DataflowFlexTemplateJobStatus defines the config connector machine state of DataflowFlexTemplateJob

func (*DataflowFlexTemplateJobStatus) DeepCopy 

func (in *DataflowFlexTemplateJobStatus) DeepCopy() *DataflowFlexTemplateJobStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobStatus.

func (*DataflowFlexTemplateJobStatus) DeepCopyInto 

func (in *DataflowFlexTemplateJobStatus) DeepCopyInto(out *DataflowFlexTemplateJobStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DatastoreIODetails 

type DatastoreIODetails struct {
	// Namespace used in the connection.
	Namespace *string `json:"namespace,omitempty"`

	// ProjectId accessed in the connection.
	ProjectID *string `json:"projectID,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.DatastoreIODetails

func (*DatastoreIODetails) DeepCopy 

func (in *DatastoreIODetails) DeepCopy() *DatastoreIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DatastoreIODetails.

func (*DatastoreIODetails) DeepCopyInto 

func (in *DatastoreIODetails) DeepCopyInto(out *DatastoreIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DebugOptions 

type DebugOptions struct {
	// When true, enables the logging of the literal hot key to the user's Cloud
	//  Logging.
	EnableHotKeyLogging *bool `json:"enableHotKeyLogging,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.DebugOptions

func (*DebugOptions) DeepCopy 

func (in *DebugOptions) DeepCopy() *DebugOptions

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DebugOptions.

func (*DebugOptions) DeepCopyInto 

func (in *DebugOptions) DeepCopyInto(out *DebugOptions)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Disk 

type Disk struct {
	// Size of disk in GB.  If zero or unspecified, the service will
	//  attempt to choose a reasonable default.
	SizeGb *int32 `json:"sizeGb,omitempty"`

	// Disk storage type, as defined by Google Compute Engine.  This
	//  must be a disk type appropriate to the project and zone in which
	//  the workers will run.  If unknown or unspecified, the service
	//  will attempt to choose a reasonable default.
	//
	//  For example, the standard persistent disk type is a resource name
	//  typically ending in "pd-standard".  If SSD persistent disks are
	//  available, the resource name typically ends with "pd-ssd".  The
	//  actual valid values are defined the Google Compute Engine API,
	//  not by the Cloud Dataflow API; consult the Google Compute Engine
	//  documentation for more information about determining the set of
	//  available disk types for a particular project and zone.
	//
	//  Google Compute Engine Disk types are local to a particular
	//  project in a particular zone, and so the resource name will
	//  typically look something like this:
	//
	//  compute.googleapis.com/projects/project-id/zones/zone/diskTypes/pd-standard
	DiskType *string `json:"diskType,omitempty"`

	// Directory in a VM where disk is mounted.
	MountPoint *string `json:"mountPoint,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Disk

func (*Disk) DeepCopy 

func (in *Disk) DeepCopy() *Disk

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Disk.

func (*Disk) DeepCopyInto 

func (in *Disk) DeepCopyInto(out *Disk)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DisplayData 

type DisplayData struct {
	// The key identifying the display data.
	//  This is intended to be used as a label for the display data
	//  when viewed in a dax monitoring system.
	Key *string `json:"key,omitempty"`

	// The namespace for the key. This is usually a class name or programming
	//  language namespace (i.e. python module) which defines the display data.
	//  This allows a dax monitoring system to specially handle the data
	//  and perform custom rendering.
	Namespace *string `json:"namespace,omitempty"`

	// Contains value if the data is of string type.
	StrValue *string `json:"strValue,omitempty"`

	// Contains value if the data is of int64 type.
	Int64Value *int64 `json:"int64Value,omitempty"`

	// Contains value if the data is of float type.
	FloatValue *float32 `json:"floatValue,omitempty"`

	// Contains value if the data is of java class type.
	JavaClassValue *string `json:"javaClassValue,omitempty"`

	// Contains value if the data is of timestamp type.
	TimestampValue *string `json:"timestampValue,omitempty"`

	// Contains value if the data is of duration type.
	DurationValue *string `json:"durationValue,omitempty"`

	// Contains value if the data is of a boolean type.
	BoolValue *bool `json:"boolValue,omitempty"`

	// A possible additional shorter value to display.
	//  For example a java_class_name_value of com.mypackage.MyDoFn
	//  will be stored with MyDoFn as the short_str_value and
	//  com.mypackage.MyDoFn as the java_class_name value.
	//  short_str_value can be displayed and java_class_name_value
	//  will be displayed as a tooltip.
	ShortStrValue *string `json:"shortStrValue,omitempty"`

	// An optional full URL.
	URL *string `json:"url,omitempty"`

	// An optional label to display in a dax UI for the element.
	Label *string `json:"label,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.DisplayData

func (*DisplayData) DeepCopy 

func (in *DisplayData) DeepCopy() *DisplayData

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DisplayData.

func (*DisplayData) DeepCopyInto 

func (in *DisplayData) DeepCopyInto(out *DisplayData)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DynamicTemplateLaunchParams 

type DynamicTemplateLaunchParams struct {
	// Path to dynamic template spec file on Cloud Storage.
	//  The file must be a Json serialized DynamicTemplateFieSpec object.
	GcsPath *string `json:"gcsPath,omitempty"`

	// Cloud Storage path for staging dependencies.
	//  Must be a valid Cloud Storage URL, beginning with `gs://`.
	StagingLocation *string `json:"stagingLocation,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.DynamicTemplateLaunchParams

func (*DynamicTemplateLaunchParams) DeepCopy 

func (in *DynamicTemplateLaunchParams) DeepCopy() *DynamicTemplateLaunchParams

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DynamicTemplateLaunchParams.

func (*DynamicTemplateLaunchParams) DeepCopyInto 

func (in *DynamicTemplateLaunchParams) DeepCopyInto(out *DynamicTemplateLaunchParams)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Environment 

type Environment struct {
	// The prefix of the resources the system should use for temporary
	//  storage.  The system will append the suffix "/temp-{JOBNAME} to
	//  this resource prefix, where {JOBNAME} is the value of the
	//  job_name field.  The resulting bucket and object prefix is used
	//  as the prefix of the resources used to store temporary data
	//  needed during the job execution.  NOTE: This will override the
	//  value in taskrunner_settings.
	//  The supported resource type is:
	//
	//  Google Cloud Storage:
	//
	//    storage.googleapis.com/{bucket}/{object}
	//    bucket.storage.googleapis.com/{object}
	TempStoragePrefix *string `json:"tempStoragePrefix,omitempty"`

	// The type of cluster manager API to use.  If unknown or
	//  unspecified, the service will attempt to choose a reasonable
	//  default.  This should be in the form of the API service name,
	//  e.g. "compute.googleapis.com".
	ClusterManagerApiService *string `json:"clusterManagerApiService,omitempty"`

	// The list of experiments to enable. This field should be used for SDK
	//  related experiments and not for service related experiments. The proper
	//  field for service related experiments is service_options.
	Experiments []string `json:"experiments,omitempty"`

	// The list of service options to enable. This field should be used for
	//  service related experiments only. These experiments, when graduating to GA,
	//  should be replaced by dedicated fields or become default (i.e. always on).
	ServiceOptions []string `json:"serviceOptions,omitempty"`

	// If set, contains the Cloud KMS key identifier used to encrypt data
	//  at rest, AKA a Customer Managed Encryption Key (CMEK).
	//
	//  Format:
	//    projects/PROJECT_ID/locations/LOCATION/keyRings/KEY_RING/cryptoKeys/KEY
	ServiceKmsKeyName *string `json:"serviceKmsKeyName,omitempty"`

	// The worker pools. At least one "harness" worker pool must be
	//  specified in order for the job to have workers.
	WorkerPools []WorkerPool `json:"workerPools,omitempty"`

	// A description of the process that generated the request.
	UserAgent *google_protobuf_Struct `json:"userAgent,omitempty"`

	// A structure describing which components and their versions of the service
	//  are required in order to run the job.
	Version *google_protobuf_Struct `json:"version,omitempty"`

	// The dataset for the current project where various workflow
	//  related tables are stored.
	//
	//  The supported resource type is:
	//
	//  Google BigQuery:
	//    bigquery.googleapis.com/{dataset}
	Dataset *string `json:"dataset,omitempty"`

	// The Cloud Dataflow SDK pipeline options specified by the user. These
	//  options are passed through the service and are used to recreate the
	//  SDK pipeline options on the worker in a language agnostic and platform
	//  independent way.
	SdkPipelineOptions *google_protobuf_Struct `json:"sdkPipelineOptions,omitempty"`

	// Experimental settings.
	InternalExperiments *google_protobuf_Any `json:"internalExperiments,omitempty"`

	// Identity to run virtual machines as. Defaults to the default account.
	ServiceAccountEmail *string `json:"serviceAccountEmail,omitempty"`

	// Which Flexible Resource Scheduling mode to run in.
	FlexResourceSchedulingGoal *string `json:"flexResourceSchedulingGoal,omitempty"`

	// The Compute Engine region
	//  (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
	//  which worker processing should occur, e.g. "us-west1". Mutually exclusive
	//  with worker_zone. If neither worker_region nor worker_zone is specified,
	//  default to the control plane's region.
	WorkerRegion *string `json:"workerRegion,omitempty"`

	// The Compute Engine zone
	//  (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
	//  which worker processing should occur, e.g. "us-west1-a". Mutually exclusive
	//  with worker_region. If neither worker_region nor worker_zone is specified,
	//  a zone in the control plane's region is chosen based on available capacity.
	WorkerZone *string `json:"workerZone,omitempty"`

	// Output only. The shuffle mode used for the job.
	ShuffleMode *string `json:"shuffleMode,omitempty"`

	// Any debugging options to be supplied to the job.
	DebugOptions *DebugOptions `json:"debugOptions,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Environment

func (*Environment) DeepCopy 

func (in *Environment) DeepCopy() *Environment

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Environment.

func (*Environment) DeepCopyInto 

func (in *Environment) DeepCopyInto(out *Environment)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ExecutionStageState 

type ExecutionStageState struct {
	// The name of the execution stage.
	ExecutionStageName *string `json:"executionStageName,omitempty"`

	// Executions stage states allow the same set of values as JobState.
	ExecutionStageState *string `json:"executionStageState,omitempty"`

	// The time at which the stage transitioned to this state.
	CurrentStateTime *string `json:"currentStateTime,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ExecutionStageState

func (*ExecutionStageState) DeepCopy 

func (in *ExecutionStageState) DeepCopy() *ExecutionStageState

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ExecutionStageState.

func (*ExecutionStageState) DeepCopyInto 

func (in *ExecutionStageState) DeepCopyInto(out *ExecutionStageState)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ExecutionStageSummary 

type ExecutionStageSummary struct {
	// Dataflow service generated name for this stage.
	Name *string `json:"name,omitempty"`

	// Dataflow service generated id for this stage.
	ID *string `json:"id,omitempty"`

	// Type of transform this stage is executing.
	Kind *string `json:"kind,omitempty"`

	// Input sources for this stage.
	InputSource []ExecutionStageSummary_StageSource `json:"inputSource,omitempty"`

	// Output sources for this stage.
	OutputSource []ExecutionStageSummary_StageSource `json:"outputSource,omitempty"`

	// Other stages that must complete before this stage can run.
	PrerequisiteStage []string `json:"prerequisiteStage,omitempty"`

	// Transforms that comprise this execution stage.
	ComponentTransform []ExecutionStageSummary_ComponentTransform `json:"componentTransform,omitempty"`

	// Collections produced and consumed by component transforms of this stage.
	ComponentSource []ExecutionStageSummary_ComponentSource `json:"componentSource,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ExecutionStageSummary

func (*ExecutionStageSummary) DeepCopy 

func (in *ExecutionStageSummary) DeepCopy() *ExecutionStageSummary

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ExecutionStageSummary.

func (*ExecutionStageSummary) DeepCopyInto 

func (in *ExecutionStageSummary) DeepCopyInto(out *ExecutionStageSummary)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ExecutionStageSummary_ComponentSource 

type ExecutionStageSummary_ComponentSource struct {
	// Human-readable name for this transform; may be user or system generated.
	UserName *string `json:"userName,omitempty"`

	// Dataflow service generated name for this source.
	Name *string `json:"name,omitempty"`

	// User name for the original user transform or collection with which this
	//  source is most closely associated.
	OriginalTransformOrCollection *string `json:"originalTransformOrCollection,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ExecutionStageSummary.ComponentSource

func (*ExecutionStageSummary_ComponentSource) DeepCopy 

func (in *ExecutionStageSummary_ComponentSource) DeepCopy() *ExecutionStageSummary_ComponentSource

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ExecutionStageSummary_ComponentSource.

func (*ExecutionStageSummary_ComponentSource) DeepCopyInto 

func (in *ExecutionStageSummary_ComponentSource) DeepCopyInto(out *ExecutionStageSummary_ComponentSource)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ExecutionStageSummary_ComponentTransform 

type ExecutionStageSummary_ComponentTransform struct {
	// Human-readable name for this transform; may be user or system generated.
	UserName *string `json:"userName,omitempty"`

	// Dataflow service generated name for this source.
	Name *string `json:"name,omitempty"`

	// User name for the original user transform with which this transform is
	//  most closely associated.
	OriginalTransform *string `json:"originalTransform,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ExecutionStageSummary.ComponentTransform

func (*ExecutionStageSummary_ComponentTransform) DeepCopy 

func (in *ExecutionStageSummary_ComponentTransform) DeepCopy() *ExecutionStageSummary_ComponentTransform

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ExecutionStageSummary_ComponentTransform.

func (*ExecutionStageSummary_ComponentTransform) DeepCopyInto 

func (in *ExecutionStageSummary_ComponentTransform) DeepCopyInto(out *ExecutionStageSummary_ComponentTransform)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ExecutionStageSummary_StageSource 

type ExecutionStageSummary_StageSource struct {
	// Human-readable name for this source; may be user or system generated.
	UserName *string `json:"userName,omitempty"`

	// Dataflow service generated name for this source.
	Name *string `json:"name,omitempty"`

	// User name for the original user transform or collection with which this
	//  source is most closely associated.
	OriginalTransformOrCollection *string `json:"originalTransformOrCollection,omitempty"`

	// Size of the source, if measurable.
	SizeBytes *int64 `json:"sizeBytes,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ExecutionStageSummary.StageSource

func (*ExecutionStageSummary_StageSource) DeepCopy 

func (in *ExecutionStageSummary_StageSource) DeepCopy() *ExecutionStageSummary_StageSource

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ExecutionStageSummary_StageSource.

func (*ExecutionStageSummary_StageSource) DeepCopyInto 

func (in *ExecutionStageSummary_StageSource) DeepCopyInto(out *ExecutionStageSummary_StageSource)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type FailedLocation 

type FailedLocation struct {
	// The name of the [regional endpoint]
	//  (https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) that
	//  failed to respond.
	Name *string `json:"name,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.FailedLocation

func (*FailedLocation) DeepCopy 

func (in *FailedLocation) DeepCopy() *FailedLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new FailedLocation.

func (*FailedLocation) DeepCopyInto 

func (in *FailedLocation) DeepCopyInto(out *FailedLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type FileIODetails 

type FileIODetails struct {
	// File Pattern used to access files by the connector.
	FilePattern *string `json:"filePattern,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.FileIODetails

func (*FileIODetails) DeepCopy 

func (in *FileIODetails) DeepCopy() *FileIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new FileIODetails.

func (*FileIODetails) DeepCopyInto 

func (in *FileIODetails) DeepCopyInto(out *FileIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type FlexTemplateRuntimeEnvironment 

type FlexTemplateRuntimeEnvironment struct {
}

func (*FlexTemplateRuntimeEnvironment) DeepCopy 

func (in *FlexTemplateRuntimeEnvironment) DeepCopy() *FlexTemplateRuntimeEnvironment

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new FlexTemplateRuntimeEnvironment.

func (*FlexTemplateRuntimeEnvironment) DeepCopyInto 

func (in *FlexTemplateRuntimeEnvironment) DeepCopyInto(out *FlexTemplateRuntimeEnvironment)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type InvalidTemplateParameters 

type InvalidTemplateParameters struct {
	// Describes all parameter violations in a template request.
	ParameterViolations []InvalidTemplateParameters_ParameterViolation `json:"parameterViolations,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.InvalidTemplateParameters

func (*InvalidTemplateParameters) DeepCopy 

func (in *InvalidTemplateParameters) DeepCopy() *InvalidTemplateParameters

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new InvalidTemplateParameters.

func (*InvalidTemplateParameters) DeepCopyInto 

func (in *InvalidTemplateParameters) DeepCopyInto(out *InvalidTemplateParameters)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type InvalidTemplateParameters_ParameterViolation 

type InvalidTemplateParameters_ParameterViolation struct {
	// The parameter that failed to validate.
	Parameter *string `json:"parameter,omitempty"`

	// A description of why the parameter failed to validate.
	Description *string `json:"description,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.InvalidTemplateParameters.ParameterViolation

func (*InvalidTemplateParameters_ParameterViolation) DeepCopy 

func (in *InvalidTemplateParameters_ParameterViolation) DeepCopy() *InvalidTemplateParameters_ParameterViolation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new InvalidTemplateParameters_ParameterViolation.

func (*InvalidTemplateParameters_ParameterViolation) DeepCopyInto 

func (in *InvalidTemplateParameters_ParameterViolation) DeepCopyInto(out *InvalidTemplateParameters_ParameterViolation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Job 

type Job struct {
	// The unique ID of this job.
	//
	//  This field is set by the Cloud Dataflow service when the Job is
	//  created, and is immutable for the life of the job.
	ID *string `json:"id,omitempty"`

	// The ID of the Cloud Platform project that the job belongs to.
	ProjectID *string `json:"projectID,omitempty"`

	// The user-specified Cloud Dataflow job name.
	//
	//  Only one Job with a given name may exist in a project at any
	//  given time. If a caller attempts to create a Job with the same
	//  name as an already-existing Job, the attempt returns the
	//  existing Job.
	//
	//  The name must match the regular expression
	//  `[a-z]([-a-z0-9]{0,1022}[a-z0-9])?`
	Name *string `json:"name,omitempty"`

	// The type of Cloud Dataflow job.
	Type *string `json:"type,omitempty"`

	// The environment for the job.
	Environment *Environment `json:"environment,omitempty"`

	// Exactly one of step or steps_location should be specified.
	//
	//  The top-level steps that constitute the entire job. Only retrieved with
	//  JOB_VIEW_ALL.
	Steps []Step `json:"steps,omitempty"`

	// The Cloud Storage location where the steps are stored.
	StepsLocation *string `json:"stepsLocation,omitempty"`

	// The current state of the job.
	//
	//  Jobs are created in the `JOB_STATE_STOPPED` state unless otherwise
	//  specified.
	//
	//  A job in the `JOB_STATE_RUNNING` state may asynchronously enter a
	//  terminal state. After a job has reached a terminal state, no
	//  further state updates may be made.
	//
	//  This field may be mutated by the Cloud Dataflow service;
	//  callers cannot mutate it.
	CurrentState *string `json:"currentState,omitempty"`

	// The timestamp associated with the current state.
	CurrentStateTime *string `json:"currentStateTime,omitempty"`

	// The job's requested state.
	//
	//  `UpdateJob` may be used to switch between the `JOB_STATE_STOPPED` and
	//  `JOB_STATE_RUNNING` states, by setting requested_state.  `UpdateJob` may
	//  also be used to directly set a job's requested state to
	//  `JOB_STATE_CANCELLED` or `JOB_STATE_DONE`, irrevocably terminating the
	//  job if it has not already reached a terminal state.
	RequestedState *string `json:"requestedState,omitempty"`

	// Deprecated.
	ExecutionInfo *JobExecutionInfo `json:"executionInfo,omitempty"`

	// The timestamp when the job was initially created. Immutable and set by the
	//  Cloud Dataflow service.
	CreateTime *string `json:"createTime,omitempty"`

	// If this job is an update of an existing job, this field is the job ID
	//  of the job it replaced.
	//
	//  When sending a `CreateJobRequest`, you can update a job by specifying it
	//  here. The job named here is stopped, and its intermediate state is
	//  transferred to this job.
	ReplaceJobID *string `json:"replaceJobID,omitempty"`

	// The map of transform name prefixes of the job to be replaced to the
	//  corresponding name prefixes of the new job.
	TransformNameMapping map[string]string `json:"transformNameMapping,omitempty"`

	// The client's unique identifier of the job, re-used across retried attempts.
	//  If this field is set, the service will ensure its uniqueness.
	//  The request to create a job will fail if the service has knowledge of a
	//  previously submitted job with the same client's ID and job name.
	//  The caller may use this field to ensure idempotence of job
	//  creation across retried attempts to create a job.
	//  By default, the field is empty and, in that case, the service ignores it.
	ClientRequestID *string `json:"clientRequestID,omitempty"`

	// If another job is an update of this job (and thus, this job is in
	//  `JOB_STATE_UPDATED`), this field contains the ID of that job.
	ReplacedByJobID *string `json:"replacedByJobID,omitempty"`

	// A set of files the system should be aware of that are used
	//  for temporary storage. These temporary files will be
	//  removed on job completion.
	//  No duplicates are allowed.
	//  No file patterns are supported.
	//
	//  The supported files are:
	//
	//  Google Cloud Storage:
	//
	//     storage.googleapis.com/{bucket}/{object}
	//     bucket.storage.googleapis.com/{object}
	TempFiles []string `json:"tempFiles,omitempty"`

	// User-defined labels for this job.
	//
	//  The labels map can contain no more than 64 entries.  Entries of the labels
	//  map are UTF8 strings that comply with the following restrictions:
	//
	//  * Keys must conform to regexp:  [\p{Ll}\p{Lo}][\p{Ll}\p{Lo}\p{N}_-]{0,62}
	//  * Values must conform to regexp:  [\p{Ll}\p{Lo}\p{N}_-]{0,63}
	//  * Both keys and values are additionally constrained to be <= 128 bytes in
	//  size.
	Labels map[string]string `json:"labels,omitempty"`

	// The [regional endpoint]
	//  (https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) that
	//  contains this job.
	Location *string `json:"location,omitempty"`

	// Preliminary field: The format of this data may change at any time.
	//  A description of the user pipeline and stages through which it is executed.
	//  Created by Cloud Dataflow service.  Only retrieved with
	//  JOB_VIEW_DESCRIPTION or JOB_VIEW_ALL.
	PipelineDescription *PipelineDescription `json:"pipelineDescription,omitempty"`

	// This field may be mutated by the Cloud Dataflow service;
	//  callers cannot mutate it.
	StageStates []ExecutionStageState `json:"stageStates,omitempty"`

	// This field is populated by the Dataflow service to support filtering jobs
	//  by the metadata values provided here. Populated for ListJobs and all GetJob
	//  views SUMMARY and higher.
	JobMetadata *JobMetadata `json:"jobMetadata,omitempty"`

	// The timestamp when the job was started (transitioned to JOB_STATE_PENDING).
	//  Flexible resource scheduling jobs are started with some delay after job
	//  creation, so start_time is unset before start and is updated when the
	//  job is started by the Cloud Dataflow service. For other jobs, start_time
	//  always equals to create_time and is immutable and set by the Cloud Dataflow
	//  service.
	StartTime *string `json:"startTime,omitempty"`

	// If this is specified, the job's initial state is populated from the given
	//  snapshot.
	CreatedFromSnapshotID *string `json:"createdFromSnapshotID,omitempty"`

	// Reserved for future use. This field is set only in responses from the
	//  server; it is ignored if it is set in any requests.
	SatisfiesPzs *bool `json:"satisfiesPzs,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Job

func (*Job) DeepCopy 

func (in *Job) DeepCopy() *Job

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Job.

func (*Job) DeepCopyInto 

func (in *Job) DeepCopyInto(out *Job)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobExecutionDetails 

type JobExecutionDetails struct {
	// The stages of the job execution.
	Stages []StageSummary `json:"stages,omitempty"`

	// If present, this response does not contain all requested tasks.  To obtain
	//  the next page of results, repeat the request with page_token set to this
	//  value.
	NextPageToken *string `json:"nextPageToken,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.JobExecutionDetails

func (*JobExecutionDetails) DeepCopy 

func (in *JobExecutionDetails) DeepCopy() *JobExecutionDetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobExecutionDetails.

func (*JobExecutionDetails) DeepCopyInto 

func (in *JobExecutionDetails) DeepCopyInto(out *JobExecutionDetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobExecutionInfo 

type JobExecutionInfo struct {
}

+kcc:proto=google.dataflow.v1beta3.JobExecutionInfo

func (*JobExecutionInfo) DeepCopy 

func (in *JobExecutionInfo) DeepCopy() *JobExecutionInfo

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobExecutionInfo.

func (*JobExecutionInfo) DeepCopyInto 

func (in *JobExecutionInfo) DeepCopyInto(out *JobExecutionInfo)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobExecutionStageInfo 

type JobExecutionStageInfo struct {
	// The steps associated with the execution stage.
	//  Note that stages may have several steps, and that a given step
	//  might be run by more than one stage.
	StepName []string `json:"stepName,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.JobExecutionStageInfo

func (*JobExecutionStageInfo) DeepCopy 

func (in *JobExecutionStageInfo) DeepCopy() *JobExecutionStageInfo

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobExecutionStageInfo.

func (*JobExecutionStageInfo) DeepCopyInto 

func (in *JobExecutionStageInfo) DeepCopyInto(out *JobExecutionStageInfo)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobMessage 

type JobMessage struct {
	// Deprecated.
	ID *string `json:"id,omitempty"`

	// The timestamp of the message.
	Time *string `json:"time,omitempty"`

	// The text of the message.
	MessageText *string `json:"messageText,omitempty"`

	// Importance level of the message.
	MessageImportance *string `json:"messageImportance,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.JobMessage

func (*JobMessage) DeepCopy 

func (in *JobMessage) DeepCopy() *JobMessage

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobMessage.

func (*JobMessage) DeepCopyInto 

func (in *JobMessage) DeepCopyInto(out *JobMessage)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobMetadata 

type JobMetadata struct {
}

func (*JobMetadata) DeepCopy 

func (in *JobMetadata) DeepCopy() *JobMetadata

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobMetadata.

func (*JobMetadata) DeepCopyInto 

func (in *JobMetadata) DeepCopyInto(out *JobMetadata)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobMetrics 

type JobMetrics struct {
	// Timestamp as of which metric values are current.
	MetricTime *string `json:"metricTime,omitempty"`

	// All metrics for this job.
	Metrics []MetricUpdate `json:"metrics,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.JobMetrics

func (*JobMetrics) DeepCopy 

func (in *JobMetrics) DeepCopy() *JobMetrics

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobMetrics.

func (*JobMetrics) DeepCopyInto 

func (in *JobMetrics) DeepCopyInto(out *JobMetrics)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type KeyRangeDataDiskAssignment 

type KeyRangeDataDiskAssignment struct {
	// The start (inclusive) of the key range.
	Start *string `json:"start,omitempty"`

	// The end (exclusive) of the key range.
	End *string `json:"end,omitempty"`

	// The name of the data disk where data for this range is stored.
	//  This name is local to the Google Cloud Platform project and uniquely
	//  identifies the disk within that project, for example
	//  "myproject-1014-104817-4c2-harness-0-disk-1".
	DataDisk *string `json:"dataDisk,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.KeyRangeDataDiskAssignment

func (*KeyRangeDataDiskAssignment) DeepCopy 

func (in *KeyRangeDataDiskAssignment) DeepCopy() *KeyRangeDataDiskAssignment

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new KeyRangeDataDiskAssignment.

func (*KeyRangeDataDiskAssignment) DeepCopyInto 

func (in *KeyRangeDataDiskAssignment) DeepCopyInto(out *KeyRangeDataDiskAssignment)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type KeyRangeLocation 

type KeyRangeLocation struct {
	// The start (inclusive) of the key range.
	Start *string `json:"start,omitempty"`

	// The end (exclusive) of the key range.
	End *string `json:"end,omitempty"`

	// The physical location of this range assignment to be used for
	//  streaming computation cross-worker message delivery.
	DeliveryEndpoint *string `json:"deliveryEndpoint,omitempty"`

	// The name of the data disk where data for this range is stored.
	//  This name is local to the Google Cloud Platform project and uniquely
	//  identifies the disk within that project, for example
	//  "myproject-1014-104817-4c2-harness-0-disk-1".
	DataDisk *string `json:"dataDisk,omitempty"`

	// DEPRECATED. The location of the persistent state for this range, as a
	//  persistent directory in the worker local filesystem.
	DeprecatedPersistentDirectory *string `json:"deprecatedPersistentDirectory,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.KeyRangeLocation

func (*KeyRangeLocation) DeepCopy 

func (in *KeyRangeLocation) DeepCopy() *KeyRangeLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new KeyRangeLocation.

func (*KeyRangeLocation) DeepCopyInto 

func (in *KeyRangeLocation) DeepCopyInto(out *KeyRangeLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type LaunchFlexTemplateParameter 

type LaunchFlexTemplateParameter struct {
	// Required. The job name to use for the created job. For update job request,
	//  job name should be same as the existing running job.
	JobName *string `json:"jobName,omitempty"`

	// Spec about the container image to launch.
	ContainerSpec *ContainerSpec `json:"containerSpec,omitempty"`

	// Cloud Storage path to a file with json serialized ContainerSpec as
	//  content.
	ContainerSpecGcsPath *string `json:"containerSpecGcsPath,omitempty"`

	// The parameters for FlexTemplate.
	//  Ex. {"num_workers":"5"}
	Parameters map[string]string `json:"parameters,omitempty"`

	// Launch options for this flex template job. This is a common set of options
	//  across languages and templates. This should not be used to pass job
	//  parameters.
	LaunchOptions map[string]string `json:"launchOptions,omitempty"`

	// The runtime environment for the FlexTemplate job
	Environment *FlexTemplateRuntimeEnvironment `json:"environment,omitempty"`

	// Set this to true if you are sending a request to update a running
	//  streaming job. When set, the job name should be the same as the
	//  running job.
	Update *bool `json:"update,omitempty"`

	// Use this to pass transform_name_mappings for streaming update jobs.
	//  Ex:{"oldTransformName":"newTransformName",...}'
	TransformNameMappings map[string]string `json:"transformNameMappings,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.LaunchFlexTemplateParameter

func (*LaunchFlexTemplateParameter) DeepCopy 

func (in *LaunchFlexTemplateParameter) DeepCopy() *LaunchFlexTemplateParameter

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new LaunchFlexTemplateParameter.

func (*LaunchFlexTemplateParameter) DeepCopyInto 

func (in *LaunchFlexTemplateParameter) DeepCopyInto(out *LaunchFlexTemplateParameter)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type LaunchTemplateParameters 

type LaunchTemplateParameters struct {
	// Required. The job name to use for the created job.
	JobName *string `json:"jobName,omitempty"`

	// The runtime parameters to pass to the job.
	Parameters map[string]string `json:"parameters,omitempty"`

	// The runtime environment for the job.
	Environment *RuntimeEnvironment `json:"environment,omitempty"`

	// If set, replace the existing pipeline with the name specified by jobName
	//  with this pipeline, preserving state.
	Update *bool `json:"update,omitempty"`

	// Only applicable when updating a pipeline. Map of transform name prefixes of
	//  the job to be replaced to the corresponding name prefixes of the new job.
	TransformNameMapping map[string]string `json:"transformNameMapping,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.LaunchTemplateParameters

func (*LaunchTemplateParameters) DeepCopy 

func (in *LaunchTemplateParameters) DeepCopy() *LaunchTemplateParameters

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new LaunchTemplateParameters.

func (*LaunchTemplateParameters) DeepCopyInto 

func (in *LaunchTemplateParameters) DeepCopyInto(out *LaunchTemplateParameters)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type MetricStructuredName 

type MetricStructuredName struct {
	// Origin (namespace) of metric name. May be blank for user-define metrics;
	//  will be "dataflow" for metrics defined by the Dataflow service or SDK.
	Origin *string `json:"origin,omitempty"`

	// Worker-defined metric name.
	Name *string `json:"name,omitempty"`

	// Zero or more labeled fields which identify the part of the job this
	//  metric is associated with, such as the name of a step or collection.
	//
	//  For example, built-in counters associated with steps will have
	//  context['step'] = <step-name>. Counters associated with PCollections
	//  in the SDK will have context['pcollection'] = <pcollection-name>.
	Context map[string]string `json:"context,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.MetricStructuredName

func (*MetricStructuredName) DeepCopy 

func (in *MetricStructuredName) DeepCopy() *MetricStructuredName

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MetricStructuredName.

func (*MetricStructuredName) DeepCopyInto 

func (in *MetricStructuredName) DeepCopyInto(out *MetricStructuredName)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type MetricUpdate 

type MetricUpdate struct {
	// Name of the metric.
	Name *MetricStructuredName `json:"name,omitempty"`

	// Metric aggregation kind.  The possible metric aggregation kinds are
	//  "Sum", "Max", "Min", "Mean", "Set", "And", "Or", and "Distribution".
	//  The specified aggregation kind is case-insensitive.
	//
	//  If omitted, this is not an aggregated value but instead
	//  a single metric sample value.
	Kind *string `json:"kind,omitempty"`

	// True if this metric is reported as the total cumulative aggregate
	//  value accumulated since the worker started working on this WorkItem.
	//  By default this is false, indicating that this metric is reported
	//  as a delta that is not associated with any WorkItem.
	Cumulative *bool `json:"cumulative,omitempty"`

	// Worker-computed aggregate value for aggregation kinds "Sum", "Max", "Min",
	//  "And", and "Or".  The possible value types are Long, Double, and Boolean.
	Scalar *google_protobuf_Value `json:"scalar,omitempty"`

	// Worker-computed aggregate value for the "Mean" aggregation kind.
	//  This holds the sum of the aggregated values and is used in combination
	//  with mean_count below to obtain the actual mean aggregate value.
	//  The only possible value types are Long and Double.
	MeanSum *google_protobuf_Value `json:"meanSum,omitempty"`

	// Worker-computed aggregate value for the "Mean" aggregation kind.
	//  This holds the count of the aggregated values and is used in combination
	//  with mean_sum above to obtain the actual mean aggregate value.
	//  The only possible value type is Long.
	MeanCount *google_protobuf_Value `json:"meanCount,omitempty"`

	// Worker-computed aggregate value for the "Set" aggregation kind.  The only
	//  possible value type is a list of Values whose type can be Long, Double,
	//  or String, according to the metric's type.  All Values in the list must
	//  be of the same type.
	Set *google_protobuf_Value `json:"set,omitempty"`

	// A struct value describing properties of a distribution of numeric values.
	Distribution *google_protobuf_Value `json:"distribution,omitempty"`

	// A struct value describing properties of a Gauge.
	//  Metrics of gauge type show the value of a metric across time, and is
	//  aggregated based on the newest value.
	Gauge *google_protobuf_Value `json:"gauge,omitempty"`

	// Worker-computed aggregate value for internal use by the Dataflow
	//  service.
	Internal *google_protobuf_Value `json:"internal,omitempty"`

	// Timestamp associated with the metric value. Optional when workers are
	//  reporting work progress; it will be filled in responses from the
	//  metrics API.
	UpdateTime *string `json:"updateTime,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.MetricUpdate

func (*MetricUpdate) DeepCopy 

func (in *MetricUpdate) DeepCopy() *MetricUpdate

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MetricUpdate.

func (*MetricUpdate) DeepCopyInto 

func (in *MetricUpdate) DeepCopyInto(out *MetricUpdate)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type MountedDataDisk 

type MountedDataDisk struct {
	// The name of the data disk.
	//  This name is local to the Google Cloud Platform project and uniquely
	//  identifies the disk within that project, for example
	//  "myproject-1014-104817-4c2-harness-0-disk-1".
	DataDisk *string `json:"dataDisk,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.MountedDataDisk

func (*MountedDataDisk) DeepCopy 

func (in *MountedDataDisk) DeepCopy() *MountedDataDisk

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new MountedDataDisk.

func (*MountedDataDisk) DeepCopyInto 

func (in *MountedDataDisk) DeepCopyInto(out *MountedDataDisk)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Package 

type Package struct {
	// The name of the package.
	Name *string `json:"name,omitempty"`

	// The resource to read the package from. The supported resource type is:
	//
	//  Google Cloud Storage:
	//
	//    storage.googleapis.com/{bucket}
	//    bucket.storage.googleapis.com/
	Location *string `json:"location,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Package

func (*Package) DeepCopy 

func (in *Package) DeepCopy() *Package

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Package.

func (*Package) DeepCopyInto 

func (in *Package) DeepCopyInto(out *Package)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type PipelineDescription 

type PipelineDescription struct {
	// Description of each transform in the pipeline and collections between them.
	OriginalPipelineTransform []TransformSummary `json:"originalPipelineTransform,omitempty"`

	// Description of each stage of execution of the pipeline.
	ExecutionPipelineStage []ExecutionStageSummary `json:"executionPipelineStage,omitempty"`

	// Pipeline level display data.
	DisplayData []DisplayData `json:"displayData,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.PipelineDescription

func (*PipelineDescription) DeepCopy 

func (in *PipelineDescription) DeepCopy() *PipelineDescription

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new PipelineDescription.

func (*PipelineDescription) DeepCopyInto 

func (in *PipelineDescription) DeepCopyInto(out *PipelineDescription)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ProgressTimeseries 

type ProgressTimeseries struct {
	// The current progress of the component, in the range [0,1].
	CurrentProgress *float64 `json:"currentProgress,omitempty"`

	// History of progress for the component.
	//
	//  Points are sorted by time.
	DataPoints []ProgressTimeseries_Point `json:"dataPoints,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ProgressTimeseries

func (*ProgressTimeseries) DeepCopy 

func (in *ProgressTimeseries) DeepCopy() *ProgressTimeseries

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ProgressTimeseries.

func (*ProgressTimeseries) DeepCopyInto 

func (in *ProgressTimeseries) DeepCopyInto(out *ProgressTimeseries)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type ProgressTimeseries_Point 

type ProgressTimeseries_Point struct {
	// The timestamp of the point.
	Time *string `json:"time,omitempty"`

	// The value of the point.
	Value *float64 `json:"value,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.ProgressTimeseries.Point

func (*ProgressTimeseries_Point) DeepCopy 

func (in *ProgressTimeseries_Point) DeepCopy() *ProgressTimeseries_Point

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new ProgressTimeseries_Point.

func (*ProgressTimeseries_Point) DeepCopyInto 

func (in *ProgressTimeseries_Point) DeepCopyInto(out *ProgressTimeseries_Point)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type PubSubIODetails 

type PubSubIODetails struct {
	// Topic accessed in the connection.
	Topic *string `json:"topic,omitempty"`

	// Subscription used in the connection.
	Subscription *string `json:"subscription,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.PubSubIODetails

func (*PubSubIODetails) DeepCopy 

func (in *PubSubIODetails) DeepCopy() *PubSubIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new PubSubIODetails.

func (*PubSubIODetails) DeepCopyInto 

func (in *PubSubIODetails) DeepCopyInto(out *PubSubIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type PubsubLocation 

type PubsubLocation struct {
	// A pubsub topic, in the form of
	//  "pubsub.googleapis.com/topics/<project-id>/<topic-name>"
	Topic *string `json:"topic,omitempty"`

	// A pubsub subscription, in the form of
	//  "pubsub.googleapis.com/subscriptions/<project-id>/<subscription-name>"
	Subscription *string `json:"subscription,omitempty"`

	// If set, contains a pubsub label from which to extract record timestamps.
	//  If left empty, record timestamps will be generated upon arrival.
	TimestampLabel *string `json:"timestampLabel,omitempty"`

	// If set, contains a pubsub label from which to extract record ids.
	//  If left empty, record deduplication will be strictly best effort.
	IDLabel *string `json:"idLabel,omitempty"`

	// Indicates whether the pipeline allows late-arriving data.
	DropLateData *bool `json:"dropLateData,omitempty"`

	// If set, specifies the pubsub subscription that will be used for tracking
	//  custom time timestamps for watermark estimation.
	TrackingSubscription *string `json:"trackingSubscription,omitempty"`

	// If true, then the client has requested to get pubsub attributes.
	WithAttributes *bool `json:"withAttributes,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.PubsubLocation

func (*PubsubLocation) DeepCopy 

func (in *PubsubLocation) DeepCopy() *PubsubLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new PubsubLocation.

func (*PubsubLocation) DeepCopyInto 

func (in *PubsubLocation) DeepCopyInto(out *PubsubLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type PubsubSnapshotMetadata 

type PubsubSnapshotMetadata struct {
}

func (*PubsubSnapshotMetadata) DeepCopy 

func (in *PubsubSnapshotMetadata) DeepCopy() *PubsubSnapshotMetadata

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new PubsubSnapshotMetadata.

func (*PubsubSnapshotMetadata) DeepCopyInto 

func (in *PubsubSnapshotMetadata) DeepCopyInto(out *PubsubSnapshotMetadata)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type RuntimeEnvironment 

type RuntimeEnvironment struct {
	// The initial number of Google Compute Engine instnaces for the job.
	NumWorkers *int32 `json:"numWorkers,omitempty"`

	// The maximum number of Google Compute Engine instances to be made
	//  available to your pipeline during execution, from 1 to 1000.
	MaxWorkers *int32 `json:"maxWorkers,omitempty"`

	// The Compute Engine [availability
	//  zone](https://cloud.google.com/compute/docs/regions-zones/regions-zones)
	//  for launching worker instances to run your pipeline.
	//  In the future, worker_zone will take precedence.
	Zone *string `json:"zone,omitempty"`

	// The email address of the service account to run the job as.
	ServiceAccountEmail *string `json:"serviceAccountEmail,omitempty"`

	// The Cloud Storage path to use for temporary files.
	//  Must be a valid Cloud Storage URL, beginning with `gs://`.
	TempLocation *string `json:"tempLocation,omitempty"`

	// Whether to bypass the safety checks for the job's temporary directory.
	//  Use with caution.
	BypassTempDirValidation *bool `json:"bypassTempDirValidation,omitempty"`

	// The machine type to use for the job. Defaults to the value from the
	//  template if not specified.
	MachineType *string `json:"machineType,omitempty"`

	// Additional experiment flags for the job, specified with the
	//  `--experiments` option.
	AdditionalExperiments []string `json:"additionalExperiments,omitempty"`

	// Network to which VMs will be assigned.  If empty or unspecified,
	//  the service will use the network "default".
	Network *string `json:"network,omitempty"`

	// Subnetwork to which VMs will be assigned, if desired. You can specify a
	//  subnetwork using either a complete URL or an abbreviated path. Expected to
	//  be of the form
	//  "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK"
	//  or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in
	//  a Shared VPC network, you must use the complete URL.
	Subnetwork *string `json:"subnetwork,omitempty"`

	// Additional user labels to be specified for the job.
	//  Keys and values should follow the restrictions specified in the [labeling
	//  restrictions](https://cloud.google.com/compute/docs/labeling-resources#restrictions)
	//  page.
	//  An object containing a list of "key": value pairs.
	//  Example: { "name": "wrench", "mass": "1kg", "count": "3" }.
	AdditionalUserLabels map[string]string `json:"additionalUserLabels,omitempty"`

	// Name for the Cloud KMS key for the job.
	//  Key format is:
	//  projects/<project>/locations/<location>/keyRings/<keyring>/cryptoKeys/<key>
	KmsKeyName *string `json:"kmsKeyName,omitempty"`

	// Configuration for VM IPs.
	IpConfiguration *string `json:"ipConfiguration,omitempty"`

	// The Compute Engine region
	//  (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
	//  which worker processing should occur, e.g. "us-west1". Mutually exclusive
	//  with worker_zone. If neither worker_region nor worker_zone is specified,
	//  default to the control plane's region.
	WorkerRegion *string `json:"workerRegion,omitempty"`

	// The Compute Engine zone
	//  (https://cloud.google.com/compute/docs/regions-zones/regions-zones) in
	//  which worker processing should occur, e.g. "us-west1-a". Mutually exclusive
	//  with worker_region. If neither worker_region nor worker_zone is specified,
	//  a zone in the control plane's region is chosen based on available capacity.
	//  If both `worker_zone` and `zone` are set, `worker_zone` takes precedence.
	WorkerZone *string `json:"workerZone,omitempty"`

	// Whether to enable Streaming Engine for the job.
	EnableStreamingEngine *bool `json:"enableStreamingEngine,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.RuntimeEnvironment

func (*RuntimeEnvironment) DeepCopy 

func (in *RuntimeEnvironment) DeepCopy() *RuntimeEnvironment

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new RuntimeEnvironment.

func (*RuntimeEnvironment) DeepCopyInto 

func (in *RuntimeEnvironment) DeepCopyInto(out *RuntimeEnvironment)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SDKInfo 

type SDKInfo struct {
	// Required. The SDK Language.
	Language *string `json:"language,omitempty"`

	// Optional. The SDK version.
	Version *string `json:"version,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.SDKInfo

func (*SDKInfo) DeepCopy 

func (in *SDKInfo) DeepCopy() *SDKInfo

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SDKInfo.

func (*SDKInfo) DeepCopyInto 

func (in *SDKInfo) DeepCopyInto(out *SDKInfo)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SdkHarnessContainerImage 

type SdkHarnessContainerImage struct {
	// A docker container image that resides in Google Container Registry.
	ContainerImage *string `json:"containerImage,omitempty"`

	// If true, recommends the Dataflow service to use only one core per SDK
	//  container instance with this image. If false (or unset) recommends using
	//  more than one core per SDK container instance with this image for
	//  efficiency. Note that Dataflow service may choose to override this property
	//  if needed.
	UseSingleCorePerContainer *bool `json:"useSingleCorePerContainer,omitempty"`

	// Environment ID for the Beam runner API proto Environment that corresponds
	//  to the current SDK Harness.
	EnvironmentID *string `json:"environmentID,omitempty"`

	// The set of capabilities enumerated in the above Environment proto. See also
	//  https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
	Capabilities []string `json:"capabilities,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.SdkHarnessContainerImage

func (*SdkHarnessContainerImage) DeepCopy 

func (in *SdkHarnessContainerImage) DeepCopy() *SdkHarnessContainerImage

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SdkHarnessContainerImage.

func (*SdkHarnessContainerImage) DeepCopyInto 

func (in *SdkHarnessContainerImage) DeepCopyInto(out *SdkHarnessContainerImage)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SdkVersion 

type SdkVersion struct {
	// The version of the SDK used to run the job.
	Version *string `json:"version,omitempty"`

	// A readable string describing the version of the SDK.
	VersionDisplayName *string `json:"versionDisplayName,omitempty"`

	// The support status for this SDK version.
	SdkSupportStatus *string `json:"sdkSupportStatus,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.SdkVersion

func (*SdkVersion) DeepCopy 

func (in *SdkVersion) DeepCopy() *SdkVersion

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SdkVersion.

func (*SdkVersion) DeepCopyInto 

func (in *SdkVersion) DeepCopyInto(out *SdkVersion)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Snapshot 

type Snapshot struct {
	// The unique ID of this snapshot.
	ID *string `json:"id,omitempty"`

	// The project this snapshot belongs to.
	ProjectID *string `json:"projectID,omitempty"`

	// The job this snapshot was created from.
	SourceJobID *string `json:"sourceJobID,omitempty"`

	// The time this snapshot was created.
	CreationTime *string `json:"creationTime,omitempty"`

	// The time after which this snapshot will be automatically deleted.
	Ttl *string `json:"ttl,omitempty"`

	// State of the snapshot.
	State *string `json:"state,omitempty"`

	// Pub/Sub snapshot metadata.
	PubsubMetadata []PubsubSnapshotMetadata `json:"pubsubMetadata,omitempty"`

	// User specified description of the snapshot. Maybe empty.
	Description *string `json:"description,omitempty"`

	// The disk byte size of the snapshot. Only available for snapshots in READY
	//  state.
	DiskSizeBytes *int64 `json:"diskSizeBytes,omitempty"`

	// Cloud region where this snapshot lives in, e.g., "us-central1".
	Region *string `json:"region,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Snapshot

func (*Snapshot) DeepCopy 

func (in *Snapshot) DeepCopy() *Snapshot

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Snapshot.

func (*Snapshot) DeepCopyInto 

func (in *Snapshot) DeepCopyInto(out *Snapshot)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type SpannerIODetails 

type SpannerIODetails struct {
	// ProjectId accessed in the connection.
	ProjectID *string `json:"projectID,omitempty"`

	// InstanceId accessed in the connection.
	InstanceID *string `json:"instanceID,omitempty"`

	// DatabaseId accessed in the connection.
	DatabaseID *string `json:"databaseID,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.SpannerIODetails

func (*SpannerIODetails) DeepCopy 

func (in *SpannerIODetails) DeepCopy() *SpannerIODetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new SpannerIODetails.

func (*SpannerIODetails) DeepCopyInto 

func (in *SpannerIODetails) DeepCopyInto(out *SpannerIODetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StageExecutionDetails 

type StageExecutionDetails struct {
	// Workers that have done work on the stage.
	Workers []WorkerDetails `json:"workers,omitempty"`

	// If present, this response does not contain all requested tasks.  To obtain
	//  the next page of results, repeat the request with page_token set to this
	//  value.
	NextPageToken *string `json:"nextPageToken,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StageExecutionDetails

func (*StageExecutionDetails) DeepCopy 

func (in *StageExecutionDetails) DeepCopy() *StageExecutionDetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StageExecutionDetails.

func (*StageExecutionDetails) DeepCopyInto 

func (in *StageExecutionDetails) DeepCopyInto(out *StageExecutionDetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StageSummary 

type StageSummary struct {
	// ID of this stage
	StageID *string `json:"stageID,omitempty"`

	// State of this stage.
	State *string `json:"state,omitempty"`

	// Start time of this stage.
	StartTime *string `json:"startTime,omitempty"`

	// End time of this stage.
	//
	//  If the work item is completed, this is the actual end time of the stage.
	//  Otherwise, it is the predicted end time.
	EndTime *string `json:"endTime,omitempty"`

	// Progress for this stage.
	//  Only applicable to Batch jobs.
	Progress *ProgressTimeseries `json:"progress,omitempty"`

	// Metrics for this stage.
	Metrics []MetricUpdate `json:"metrics,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StageSummary

func (*StageSummary) DeepCopy 

func (in *StageSummary) DeepCopy() *StageSummary

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StageSummary.

func (*StageSummary) DeepCopyInto 

func (in *StageSummary) DeepCopyInto(out *StageSummary)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StateFamilyConfig 

type StateFamilyConfig struct {
	// The state family value.
	StateFamily *string `json:"stateFamily,omitempty"`

	// If true, this family corresponds to a read operation.
	IsRead *bool `json:"isRead,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StateFamilyConfig

func (*StateFamilyConfig) DeepCopy 

func (in *StateFamilyConfig) DeepCopy() *StateFamilyConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StateFamilyConfig.

func (*StateFamilyConfig) DeepCopyInto 

func (in *StateFamilyConfig) DeepCopyInto(out *StateFamilyConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type Step 

type Step struct {
	// The kind of step in the Cloud Dataflow job.
	Kind *string `json:"kind,omitempty"`

	// The name that identifies the step. This must be unique for each
	//  step with respect to all other steps in the Cloud Dataflow job.
	Name *string `json:"name,omitempty"`

	// Named properties associated with the step. Each kind of
	//  predefined step has its own required set of properties.
	//  Must be provided on Create.  Only retrieved with JOB_VIEW_ALL.
	Properties *google_protobuf_Struct `json:"properties,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.Step

func (*Step) DeepCopy 

func (in *Step) DeepCopy() *Step

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new Step.

func (*Step) DeepCopyInto 

func (in *Step) DeepCopyInto(out *Step)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StreamLocation 

type StreamLocation struct {
	// The stream is part of another computation within the current
	//  streaming Dataflow job.
	StreamingStageLocation *StreamingStageLocation `json:"streamingStageLocation,omitempty"`

	// The stream is a pubsub stream.
	PubsubLocation *PubsubLocation `json:"pubsubLocation,omitempty"`

	// The stream is a streaming side input.
	SideInputLocation *StreamingSideInputLocation `json:"sideInputLocation,omitempty"`

	// The stream is a custom source.
	CustomSourceLocation *CustomSourceLocation `json:"customSourceLocation,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StreamLocation

func (*StreamLocation) DeepCopy 

func (in *StreamLocation) DeepCopy() *StreamLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StreamLocation.

func (*StreamLocation) DeepCopyInto 

func (in *StreamLocation) DeepCopyInto(out *StreamLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StreamingApplianceSnapshotConfig 

type StreamingApplianceSnapshotConfig struct {
	// If set, indicates the snapshot id for the snapshot being performed.
	SnapshotID *string `json:"snapshotID,omitempty"`

	// Indicates which endpoint is used to import appliance state.
	ImportStateEndpoint *string `json:"importStateEndpoint,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StreamingApplianceSnapshotConfig

func (*StreamingApplianceSnapshotConfig) DeepCopy 

func (in *StreamingApplianceSnapshotConfig) DeepCopy() *StreamingApplianceSnapshotConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StreamingApplianceSnapshotConfig.

func (*StreamingApplianceSnapshotConfig) DeepCopyInto 

func (in *StreamingApplianceSnapshotConfig) DeepCopyInto(out *StreamingApplianceSnapshotConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StreamingComputationRanges 

type StreamingComputationRanges struct {
	// The ID of the computation.
	ComputationID *string `json:"computationID,omitempty"`

	// Data disk assignments for ranges from this computation.
	RangeAssignments []KeyRangeDataDiskAssignment `json:"rangeAssignments,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StreamingComputationRanges

func (*StreamingComputationRanges) DeepCopy 

func (in *StreamingComputationRanges) DeepCopy() *StreamingComputationRanges

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StreamingComputationRanges.

func (*StreamingComputationRanges) DeepCopyInto 

func (in *StreamingComputationRanges) DeepCopyInto(out *StreamingComputationRanges)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StreamingSideInputLocation 

type StreamingSideInputLocation struct {
	// Identifies the particular side input within the streaming Dataflow job.
	Tag *string `json:"tag,omitempty"`

	// Identifies the state family where this side input is stored.
	StateFamily *string `json:"stateFamily,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StreamingSideInputLocation

func (*StreamingSideInputLocation) DeepCopy 

func (in *StreamingSideInputLocation) DeepCopy() *StreamingSideInputLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StreamingSideInputLocation.

func (*StreamingSideInputLocation) DeepCopyInto 

func (in *StreamingSideInputLocation) DeepCopyInto(out *StreamingSideInputLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StreamingStageLocation 

type StreamingStageLocation struct {
	// Identifies the particular stream within the streaming Dataflow
	//  job.
	StreamID *string `json:"streamID,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StreamingStageLocation

func (*StreamingStageLocation) DeepCopy 

func (in *StreamingStageLocation) DeepCopy() *StreamingStageLocation

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StreamingStageLocation.

func (*StreamingStageLocation) DeepCopyInto 

func (in *StreamingStageLocation) DeepCopyInto(out *StreamingStageLocation)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StructuredMessage 

type StructuredMessage struct {
	// Human-readable version of message.
	MessageText *string `json:"messageText,omitempty"`

	// Identifier for this message type.  Used by external systems to
	//  internationalize or personalize message.
	MessageKey *string `json:"messageKey,omitempty"`

	// The structured data associated with this message.
	Parameters []StructuredMessage_Parameter `json:"parameters,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StructuredMessage

func (*StructuredMessage) DeepCopy 

func (in *StructuredMessage) DeepCopy() *StructuredMessage

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StructuredMessage.

func (*StructuredMessage) DeepCopyInto 

func (in *StructuredMessage) DeepCopyInto(out *StructuredMessage)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type StructuredMessage_Parameter 

type StructuredMessage_Parameter struct {
	// Key or name for this parameter.
	Key *string `json:"key,omitempty"`

	// Value for this parameter.
	Value *google_protobuf_Value `json:"value,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.StructuredMessage.Parameter

func (*StructuredMessage_Parameter) DeepCopy 

func (in *StructuredMessage_Parameter) DeepCopy() *StructuredMessage_Parameter

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new StructuredMessage_Parameter.

func (*StructuredMessage_Parameter) DeepCopyInto 

func (in *StructuredMessage_Parameter) DeepCopyInto(out *StructuredMessage_Parameter)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TaskRunnerSettings 

type TaskRunnerSettings struct {
	// The UNIX user ID on the worker VM to use for tasks launched by
	//  taskrunner; e.g. "root".
	TaskUser *string `json:"taskUser,omitempty"`

	// The UNIX group ID on the worker VM to use for tasks launched by
	//  taskrunner; e.g. "wheel".
	TaskGroup *string `json:"taskGroup,omitempty"`

	// The OAuth2 scopes to be requested by the taskrunner in order to
	//  access the Cloud Dataflow API.
	OauthScopes []string `json:"oauthScopes,omitempty"`

	// The base URL for the taskrunner to use when accessing Google Cloud APIs.
	//
	//  When workers access Google Cloud APIs, they logically do so via
	//  relative URLs.  If this field is specified, it supplies the base
	//  URL to use for resolving these relative URLs.  The normative
	//  algorithm used is defined by RFC 1808, "Relative Uniform Resource
	//  Locators".
	//
	//  If not specified, the default value is "http://www.googleapis.com/"
	BaseURL *string `json:"baseURL,omitempty"`

	// The API version of endpoint, e.g. "v1b3"
	DataflowApiVersion *string `json:"dataflowApiVersion,omitempty"`

	// The settings to pass to the parallel worker harness.
	ParallelWorkerSettings *WorkerSettings `json:"parallelWorkerSettings,omitempty"`

	// The location on the worker for task-specific subdirectories.
	BaseTaskDir *string `json:"baseTaskDir,omitempty"`

	// Whether to continue taskrunner if an exception is hit.
	ContinueOnException *bool `json:"continueOnException,omitempty"`

	// Whether to send taskrunner log info to Google Compute Engine VM serial
	//  console.
	LogToSerialconsole *bool `json:"logToSerialconsole,omitempty"`

	// Whether to also send taskrunner log info to stderr.
	Alsologtostderr *bool `json:"alsologtostderr,omitempty"`

	// Indicates where to put logs.  If this is not specified, the logs
	//  will not be uploaded.
	//
	//  The supported resource type is:
	//
	//  Google Cloud Storage:
	//    storage.googleapis.com/{bucket}/{object}
	//    bucket.storage.googleapis.com/{object}
	LogUploadLocation *string `json:"logUploadLocation,omitempty"`

	// The directory on the VM to store logs.
	LogDir *string `json:"logDir,omitempty"`

	// The prefix of the resources the taskrunner should use for
	//  temporary storage.
	//
	//  The supported resource type is:
	//
	//  Google Cloud Storage:
	//    storage.googleapis.com/{bucket}/{object}
	//    bucket.storage.googleapis.com/{object}
	TempStoragePrefix *string `json:"tempStoragePrefix,omitempty"`

	// The command to launch the worker harness.
	HarnessCommand *string `json:"harnessCommand,omitempty"`

	// The file to store the workflow in.
	WorkflowFileName *string `json:"workflowFileName,omitempty"`

	// The file to store preprocessing commands in.
	CommandlinesFileName *string `json:"commandlinesFileName,omitempty"`

	// The ID string of the VM.
	VmID *string `json:"vmID,omitempty"`

	// The suggested backend language.
	LanguageHint *string `json:"languageHint,omitempty"`

	// The streaming worker main class name.
	StreamingWorkerMainClass *string `json:"streamingWorkerMainClass,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.TaskRunnerSettings

func (*TaskRunnerSettings) DeepCopy 

func (in *TaskRunnerSettings) DeepCopy() *TaskRunnerSettings

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TaskRunnerSettings.

func (*TaskRunnerSettings) DeepCopyInto 

func (in *TaskRunnerSettings) DeepCopyInto(out *TaskRunnerSettings)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TemplateMetadata 

type TemplateMetadata struct {
}

func (*TemplateMetadata) DeepCopy 

func (in *TemplateMetadata) DeepCopy() *TemplateMetadata

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TemplateMetadata.

func (*TemplateMetadata) DeepCopyInto 

func (in *TemplateMetadata) DeepCopyInto(out *TemplateMetadata)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TopologyConfig 

type TopologyConfig struct {
	// The computations associated with a streaming Dataflow job.
	Computations []ComputationTopology `json:"computations,omitempty"`

	// The disks assigned to a streaming Dataflow job.
	DataDiskAssignments []DataDiskAssignment `json:"dataDiskAssignments,omitempty"`

	// Maps user stage names to stable computation names.
	UserStageToComputationNameMap map[string]string `json:"userStageToComputationNameMap,omitempty"`

	// The size (in bits) of keys that will be assigned to source messages.
	ForwardingKeyBits *int32 `json:"forwardingKeyBits,omitempty"`

	// Version number for persistent state.
	PersistentStateVersion *int32 `json:"persistentStateVersion,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.TopologyConfig

func (*TopologyConfig) DeepCopy 

func (in *TopologyConfig) DeepCopy() *TopologyConfig

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TopologyConfig.

func (*TopologyConfig) DeepCopyInto 

func (in *TopologyConfig) DeepCopyInto(out *TopologyConfig)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type TransformSummary 

type TransformSummary struct {
	// Type of transform.
	Kind *string `json:"kind,omitempty"`

	// SDK generated id of this transform instance.
	ID *string `json:"id,omitempty"`

	// User provided name for this transform instance.
	Name *string `json:"name,omitempty"`

	// Transform-specific display data.
	DisplayData []DisplayData `json:"displayData,omitempty"`

	// User  names for all collection outputs to this transform.
	OutputCollectionName []string `json:"outputCollectionName,omitempty"`

	// User names for all collection inputs to this transform.
	InputCollectionName []string `json:"inputCollectionName,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.TransformSummary

func (*TransformSummary) DeepCopy 

func (in *TransformSummary) DeepCopy() *TransformSummary

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new TransformSummary.

func (*TransformSummary) DeepCopyInto 

func (in *TransformSummary) DeepCopyInto(out *TransformSummary)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type WorkItemDetails 

type WorkItemDetails struct {
	// Name of this work item.
	TaskID *string `json:"taskID,omitempty"`

	// Attempt ID of this work item
	AttemptID *string `json:"attemptID,omitempty"`

	// Start time of this work item attempt.
	StartTime *string `json:"startTime,omitempty"`

	// End time of this work item attempt.
	//
	//  If the work item is completed, this is the actual end time of the work
	//  item.  Otherwise, it is the predicted end time.
	EndTime *string `json:"endTime,omitempty"`

	// State of this work item.
	State *string `json:"state,omitempty"`

	// Progress of this work item.
	Progress *ProgressTimeseries `json:"progress,omitempty"`

	// Metrics for this work item.
	Metrics []MetricUpdate `json:"metrics,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.WorkItemDetails

func (*WorkItemDetails) DeepCopy 

func (in *WorkItemDetails) DeepCopy() *WorkItemDetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new WorkItemDetails.

func (*WorkItemDetails) DeepCopyInto 

func (in *WorkItemDetails) DeepCopyInto(out *WorkItemDetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type WorkerDetails 

type WorkerDetails struct {
	// Name of this worker
	WorkerName *string `json:"workerName,omitempty"`

	// Work items processed by this worker, sorted by time.
	WorkItems []WorkItemDetails `json:"workItems,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.WorkerDetails

func (*WorkerDetails) DeepCopy 

func (in *WorkerDetails) DeepCopy() *WorkerDetails

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new WorkerDetails.

func (*WorkerDetails) DeepCopyInto 

func (in *WorkerDetails) DeepCopyInto(out *WorkerDetails)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type WorkerPool 

type WorkerPool struct {
	// The kind of the worker pool; currently only `harness` and `shuffle`
	//  are supported.
	Kind *string `json:"kind,omitempty"`

	// Number of Google Compute Engine workers in this pool needed to
	//  execute the job.  If zero or unspecified, the service will
	//  attempt to choose a reasonable default.
	NumWorkers *int32 `json:"numWorkers,omitempty"`

	// Packages to be installed on workers.
	Packages []Package `json:"packages,omitempty"`

	// The default package set to install.  This allows the service to
	//  select a default set of packages which are useful to worker
	//  harnesses written in a particular language.
	DefaultPackageSet *string `json:"defaultPackageSet,omitempty"`

	// Machine type (e.g. "n1-standard-1").  If empty or unspecified, the
	//  service will attempt to choose a reasonable default.
	MachineType *string `json:"machineType,omitempty"`

	// Sets the policy for determining when to turndown worker pool.
	//  Allowed values are: `TEARDOWN_ALWAYS`, `TEARDOWN_ON_SUCCESS`, and
	//  `TEARDOWN_NEVER`.
	//  `TEARDOWN_ALWAYS` means workers are always torn down regardless of whether
	//  the job succeeds. `TEARDOWN_ON_SUCCESS` means workers are torn down
	//  if the job succeeds. `TEARDOWN_NEVER` means the workers are never torn
	//  down.
	//
	//  If the workers are not torn down by the service, they will
	//  continue to run and use Google Compute Engine VM resources in the
	//  user's project until they are explicitly terminated by the user.
	//  Because of this, Google recommends using the `TEARDOWN_ALWAYS`
	//  policy except for small, manually supervised test jobs.
	//
	//  If unknown or unspecified, the service will attempt to choose a reasonable
	//  default.
	TeardownPolicy *string `json:"teardownPolicy,omitempty"`

	// Size of root disk for VMs, in GB.  If zero or unspecified, the service will
	//  attempt to choose a reasonable default.
	DiskSizeGb *int32 `json:"diskSizeGb,omitempty"`

	// Type of root disk for VMs.  If empty or unspecified, the service will
	//  attempt to choose a reasonable default.
	DiskType *string `json:"diskType,omitempty"`

	// Fully qualified source image for disks.
	DiskSourceImage *string `json:"diskSourceImage,omitempty"`

	// Zone to run the worker pools in.  If empty or unspecified, the service
	//  will attempt to choose a reasonable default.
	Zone *string `json:"zone,omitempty"`

	// Settings passed through to Google Compute Engine workers when
	//  using the standard Dataflow task runner.  Users should ignore
	//  this field.
	TaskrunnerSettings *TaskRunnerSettings `json:"taskrunnerSettings,omitempty"`

	// The action to take on host maintenance, as defined by the Google
	//  Compute Engine API.
	OnHostMaintenance *string `json:"onHostMaintenance,omitempty"`

	// Data disks that are used by a VM in this workflow.
	DataDisks []Disk `json:"dataDisks,omitempty"`

	// Metadata to set on the Google Compute Engine VMs.
	Metadata map[string]string `json:"metadata,omitempty"`

	// Settings for autoscaling of this WorkerPool.
	AutoscalingSettings *AutoscalingSettings `json:"autoscalingSettings,omitempty"`

	// Extra arguments for this worker pool.
	PoolArgs *google_protobuf_Any `json:"poolArgs,omitempty"`

	// Network to which VMs will be assigned.  If empty or unspecified,
	//  the service will use the network "default".
	Network *string `json:"network,omitempty"`

	// Subnetwork to which VMs will be assigned, if desired.  Expected to be of
	//  the form "regions/REGION/subnetworks/SUBNETWORK".
	Subnetwork *string `json:"subnetwork,omitempty"`

	// Required. Docker container image that executes the Cloud Dataflow worker
	//  harness, residing in Google Container Registry.
	//
	//  Deprecated for the Fn API path. Use sdk_harness_container_images instead.
	WorkerHarnessContainerImage *string `json:"workerHarnessContainerImage,omitempty"`

	// The number of threads per worker harness. If empty or unspecified, the
	//  service will choose a number of threads (according to the number of cores
	//  on the selected machine type for batch, or 1 by convention for streaming).
	NumThreadsPerWorker *int32 `json:"numThreadsPerWorker,omitempty"`

	// Configuration for VM IPs.
	IpConfiguration *string `json:"ipConfiguration,omitempty"`

	// Set of SDK harness containers needed to execute this pipeline. This will
	//  only be set in the Fn API path. For non-cross-language pipelines this
	//  should have only one entry. Cross-language pipelines will have two or more
	//  entries.
	SdkHarnessContainerImages []SdkHarnessContainerImage `json:"sdkHarnessContainerImages,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.WorkerPool

func (*WorkerPool) DeepCopy 

func (in *WorkerPool) DeepCopy() *WorkerPool

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new WorkerPool.

func (*WorkerPool) DeepCopyInto 

func (in *WorkerPool) DeepCopyInto(out *WorkerPool)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type WorkerSettings 

type WorkerSettings struct {
	// The base URL for accessing Google Cloud APIs.
	//
	//  When workers access Google Cloud APIs, they logically do so via
	//  relative URLs.  If this field is specified, it supplies the base
	//  URL to use for resolving these relative URLs.  The normative
	//  algorithm used is defined by RFC 1808, "Relative Uniform Resource
	//  Locators".
	//
	//  If not specified, the default value is "http://www.googleapis.com/"
	BaseURL *string `json:"baseURL,omitempty"`

	// Whether to send work progress updates to the service.
	ReportingEnabled *bool `json:"reportingEnabled,omitempty"`

	// The Cloud Dataflow service path relative to the root URL, for example,
	//  "dataflow/v1b3/projects".
	ServicePath *string `json:"servicePath,omitempty"`

	// The Shuffle service path relative to the root URL, for example,
	//  "shuffle/v1beta1".
	ShuffleServicePath *string `json:"shuffleServicePath,omitempty"`

	// The ID of the worker running this pipeline.
	WorkerID *string `json:"workerID,omitempty"`

	// The prefix of the resources the system should use for temporary
	//  storage.
	//
	//  The supported resource type is:
	//
	//  Google Cloud Storage:
	//
	//    storage.googleapis.com/{bucket}/{object}
	//    bucket.storage.googleapis.com/{object}
	TempStoragePrefix *string `json:"tempStoragePrefix,omitempty"`
}

+kcc:proto=google.dataflow.v1beta3.WorkerSettings

func (*WorkerSettings) DeepCopy 

func (in *WorkerSettings) DeepCopy() *WorkerSettings

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new WorkerSettings.

func (*WorkerSettings) DeepCopyInto 

func (in *WorkerSettings) DeepCopyInto(out *WorkerSettings)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.