v1beta1

package
v1.122.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Sep 10, 2024 License: Apache-2.0 Imports: 6 Imported by: 0

Documentation

Overview

Package v1beta1 contains API Schema definitions for the dataflow v1beta1 API group. +k8s:openapi-gen=true +k8s:deepcopy-gen=package,register +k8s:conversion-gen=github.com/GoogleCloudPlatform/k8s-config-connector/pkg/clients/generated/pkg/apis/dataflow +k8s:defaulter-gen=TypeMeta +groupName=dataflow.cnrm.cloud.google.com

Index

Constants

This section is empty.

Variables

View Source 
var (
	// SchemeGroupVersion is the group version used to register these objects.
	SchemeGroupVersion = schema.GroupVersion{Group: "dataflow.cnrm.cloud.google.com", Version: "v1beta1"}

	// SchemeBuilder is used to add go types to the GroupVersionKind scheme.
	SchemeBuilder = &scheme.Builder{GroupVersion: SchemeGroupVersion}

	// AddToScheme is a global function that registers this API group & version to a scheme
	AddToScheme = SchemeBuilder.AddToScheme

	DataflowFlexTemplateJobGVK = schema.GroupVersionKind{
		Group:   SchemeGroupVersion.Group,
		Version: SchemeGroupVersion.Version,
		Kind:    reflect.TypeOf(DataflowFlexTemplateJob{}).Name(),
	}

	DataflowJobGVK = schema.GroupVersionKind{
		Group:   SchemeGroupVersion.Group,
		Version: SchemeGroupVersion.Version,
		Kind:    reflect.TypeOf(DataflowJob{}).Name(),
	}
)

Functions

This section is empty.

Types

type DataflowFlexTemplateJob 

type DataflowFlexTemplateJob struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   DataflowFlexTemplateJobSpec   `json:"spec,omitempty"`
	Status DataflowFlexTemplateJobStatus `json:"status,omitempty"`
}

DataflowFlexTemplateJob is the Schema for the dataflow API +k8s:openapi-gen=true

func (*DataflowFlexTemplateJob) DeepCopy 

func (in *DataflowFlexTemplateJob) DeepCopy() *DataflowFlexTemplateJob

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJob.

func (*DataflowFlexTemplateJob) DeepCopyInto 

func (in *DataflowFlexTemplateJob) DeepCopyInto(out *DataflowFlexTemplateJob)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowFlexTemplateJob) DeepCopyObject 

func (in *DataflowFlexTemplateJob) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowFlexTemplateJobList 

type DataflowFlexTemplateJobList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []DataflowFlexTemplateJob `json:"items"`
}

DataflowFlexTemplateJobList contains a list of DataflowFlexTemplateJob

func (*DataflowFlexTemplateJobList) DeepCopy 

func (in *DataflowFlexTemplateJobList) DeepCopy() *DataflowFlexTemplateJobList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobList.

func (*DataflowFlexTemplateJobList) DeepCopyInto 

func (in *DataflowFlexTemplateJobList) DeepCopyInto(out *DataflowFlexTemplateJobList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowFlexTemplateJobList) DeepCopyObject 

func (in *DataflowFlexTemplateJobList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowFlexTemplateJobSpec 

type DataflowFlexTemplateJobSpec struct {
	/* Additional experiment flags for the job. */
	// +optional
	AdditionalExperiments []string `json:"additionalExperiments,omitempty"`

	/* The algorithm to use for autoscaling */
	// +optional
	AutoscalingAlgorithm *string `json:"autoscalingAlgorithm,omitempty"`

	/* Cloud Storage path to a file with json serialized ContainerSpec as content. */
	ContainerSpecGcsPath string `json:"containerSpecGcsPath"`

	/* Whether to enable Streaming Engine for the job. */
	// +optional
	EnableStreamingEngine *bool `json:"enableStreamingEngine,omitempty"`

	/* Configuration for VM IPs. */
	// +optional
	IpConfiguration *string `json:"ipConfiguration,omitempty"`

	/* The Cloud KMS key for the job. */
	// +optional
	KmsKeyNameRef *v1alpha1.ResourceRef `json:"kmsKeyNameRef,omitempty"`

	/* The machine type to use for launching the job. The default is n1-standard-1. */
	// +optional
	LauncherMachineType *string `json:"launcherMachineType,omitempty"`

	/* The machine type to use for the job. Defaults to the value from the template if not specified. */
	// +optional
	MachineType *string `json:"machineType,omitempty"`

	/* The maximum number of Google Compute Engine instances to be made available to your pipeline during execution, from 1 to 1000. */
	// +optional
	MaxWorkers *int32 `json:"maxWorkers,omitempty"`

	/* Network to which VMs will be assigned.  If empty or unspecified, the service will use the network "default". */
	// +optional
	NetworkRef *v1alpha1.ResourceRef `json:"networkRef,omitempty"`

	/* The initial number of Google Compute Engine instances for the job. */
	// +optional
	NumWorkers *int32 `json:"numWorkers,omitempty"`

	/* The parameters for FlexTemplate. Ex. {"num_workers":"5"} */
	// +optional
	Parameters *FlextemplatejobParameters `json:"parameters,omitempty"`

	/* Immutable. The region in which the created job should run. */
	// +optional
	Region *string `json:"region,omitempty"`

	/* Docker registry location of container image to use for the 'worker harness. Default is the container for the version of the SDK. Note this field is only valid for portable pipelines. */
	// +optional
	SdkContainerImage *string `json:"sdkContainerImage,omitempty"`

	/* The email address of the service account to run the job as. */
	// +optional
	ServiceAccountEmailRef *v1alpha1.ResourceRef `json:"serviceAccountEmailRef,omitempty"`

	/* The Cloud Storage path for staging local files. Must be a valid Cloud Storage URL, beginning with `gs://`. */
	// +optional
	StagingLocation *string `json:"stagingLocation,omitempty"`

	/* Subnetwork to which VMs will be assigned, if desired. You can specify a subnetwork using either a complete URL or an abbreviated path. Expected to be of the form "https://www.googleapis.com/compute/v1/projects/HOST_PROJECT_ID/regions/REGION/subnetworks/SUBNETWORK" or "regions/REGION/subnetworks/SUBNETWORK". If the subnetwork is located in a Shared VPC network, you must use the complete URL. */
	// +optional
	SubnetworkRef *v1alpha1.ResourceRef `json:"subnetworkRef,omitempty"`

	/* The Cloud Storage path to use for temporary files. Must be a valid Cloud Storage URL, beginning with `gs://`. */
	// +optional
	TempLocation *string `json:"tempLocation,omitempty"`

	/* Map of transform name prefixes of the job to be replaced with the corresponding name prefixes of the new job. Only applicable when updating a pipeline. */
	// +optional
	TransformNameMapping *FlextemplatejobTransformNameMapping `json:"transformNameMapping,omitempty"`
}

func (*DataflowFlexTemplateJobSpec) DeepCopy 

func (in *DataflowFlexTemplateJobSpec) DeepCopy() *DataflowFlexTemplateJobSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobSpec.

func (*DataflowFlexTemplateJobSpec) DeepCopyInto 

func (in *DataflowFlexTemplateJobSpec) DeepCopyInto(out *DataflowFlexTemplateJobSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowFlexTemplateJobStatus 

type DataflowFlexTemplateJobStatus struct {
	/* Conditions represent the latest available observations of the
	   DataflowFlexTemplateJob's current state. */
	Conditions []v1alpha1.Condition `json:"conditions,omitempty"`
	// +optional
	JobId *string `json:"jobId,omitempty"`

	/* ObservedGeneration is the generation of the resource that was most recently observed by the Config Connector controller. If this is equal to metadata.generation, then that means that the current reported status reflects the most recent desired state of the resource. */
	// +optional
	ObservedGeneration *int64 `json:"observedGeneration,omitempty"`

	/* The current state of the job.

	Jobs are created in the `JOB_STATE_STOPPED` state unless otherwise
	specified.

	A job in the `JOB_STATE_RUNNING` state may asynchronously enter a
	terminal state. After a job has reached a terminal state, no
	further state updates may be made.

	This field may be mutated by the Cloud Dataflow service;
	callers cannot mutate it. */
	// +optional
	State *string `json:"state,omitempty"`

	/* The type of Cloud Dataflow job. */
	// +optional
	Type *string `json:"type,omitempty"`
}

func (*DataflowFlexTemplateJobStatus) DeepCopy 

func (in *DataflowFlexTemplateJobStatus) DeepCopy() *DataflowFlexTemplateJobStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowFlexTemplateJobStatus.

func (*DataflowFlexTemplateJobStatus) DeepCopyInto 

func (in *DataflowFlexTemplateJobStatus) DeepCopyInto(out *DataflowFlexTemplateJobStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowJob 

type DataflowJob struct {
	metav1.TypeMeta   `json:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty"`

	Spec   DataflowJobSpec   `json:"spec,omitempty"`
	Status DataflowJobStatus `json:"status,omitempty"`
}

DataflowJob is the Schema for the dataflow API +k8s:openapi-gen=true

func (*DataflowJob) DeepCopy 

func (in *DataflowJob) DeepCopy() *DataflowJob

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowJob.

func (*DataflowJob) DeepCopyInto 

func (in *DataflowJob) DeepCopyInto(out *DataflowJob)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowJob) DeepCopyObject 

func (in *DataflowJob) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowJobList 

type DataflowJobList struct {
	metav1.TypeMeta `json:",inline"`
	metav1.ListMeta `json:"metadata,omitempty"`
	Items           []DataflowJob `json:"items"`
}

DataflowJobList contains a list of DataflowJob

func (*DataflowJobList) DeepCopy 

func (in *DataflowJobList) DeepCopy() *DataflowJobList

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowJobList.

func (*DataflowJobList) DeepCopyInto 

func (in *DataflowJobList) DeepCopyInto(out *DataflowJobList)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

func (*DataflowJobList) DeepCopyObject 

func (in *DataflowJobList) DeepCopyObject() runtime.Object

DeepCopyObject is an autogenerated deepcopy function, copying the receiver, creating a new runtime.Object.

type DataflowJobSpec 

type DataflowJobSpec struct {
	/* List of experiments that should be used by the job. An example value is ["enable_stackdriver_agent_metrics"]. */
	// +optional
	AdditionalExperiments []string `json:"additionalExperiments,omitempty"`

	/* Indicates if the job should use the streaming engine feature. */
	// +optional
	EnableStreamingEngine *bool `json:"enableStreamingEngine,omitempty"`

	/* The configuration for VM IPs. Options are "WORKER_IP_PUBLIC" or "WORKER_IP_PRIVATE". */
	// +optional
	IpConfiguration *string `json:"ipConfiguration,omitempty"`

	/* The name for the Cloud KMS key for the job. */
	// +optional
	KmsKeyRef *v1alpha1.ResourceRef `json:"kmsKeyRef,omitempty"`

	/* The machine type to use for the job. */
	// +optional
	MachineType *string `json:"machineType,omitempty"`

	/* Immutable. The number of workers permitted to work on the job. More workers may improve processing speed at additional cost. */
	// +optional
	MaxWorkers *int64 `json:"maxWorkers,omitempty"`

	// +optional
	NetworkRef *v1alpha1.ResourceRef `json:"networkRef,omitempty"`

	/* Key/Value pairs to be passed to the Dataflow job (as used in the template). */
	// +optional
	Parameters *JobParameters `json:"parameters,omitempty"`

	/* Immutable. The region in which the created job should run. */
	// +optional
	Region *string `json:"region,omitempty"`

	/* Immutable. Optional. The name of the resource. Used for creation and acquisition. When unset, the value of `metadata.name` is used as the default. */
	// +optional
	ResourceID *string `json:"resourceID,omitempty"`

	// +optional
	ServiceAccountRef *v1alpha1.ResourceRef `json:"serviceAccountRef,omitempty"`

	// +optional
	SubnetworkRef *v1alpha1.ResourceRef `json:"subnetworkRef,omitempty"`

	/* A writeable location on Google Cloud Storage for the Dataflow job to dump its temporary data. */
	TempGcsLocation string `json:"tempGcsLocation"`

	/* The Google Cloud Storage path to the Dataflow job template. */
	TemplateGcsPath string `json:"templateGcsPath"`

	/* Only applicable when updating a pipeline. Map of transform name prefixes of the job to be replaced with the corresponding name prefixes of the new job. */
	// +optional
	TransformNameMapping *JobTransformNameMapping `json:"transformNameMapping,omitempty"`

	/* Immutable. The zone in which the created job should run. If it is not provided, the provider zone is used. */
	// +optional
	Zone *string `json:"zone,omitempty"`
}

func (*DataflowJobSpec) DeepCopy 

func (in *DataflowJobSpec) DeepCopy() *DataflowJobSpec

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowJobSpec.

func (*DataflowJobSpec) DeepCopyInto 

func (in *DataflowJobSpec) DeepCopyInto(out *DataflowJobSpec)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type DataflowJobStatus 

type DataflowJobStatus struct {
	/* Conditions represent the latest available observations of the
	   DataflowJob's current state. */
	Conditions []v1alpha1.Condition `json:"conditions,omitempty"`
	/* The unique ID of this job. */
	// +optional
	JobId *string `json:"jobId,omitempty"`

	/* ObservedGeneration is the generation of the resource that was most recently observed by the Config Connector controller. If this is equal to metadata.generation, then that means that the current reported status reflects the most recent desired state of the resource. */
	// +optional
	ObservedGeneration *int64 `json:"observedGeneration,omitempty"`

	/* The current state of the resource, selected from the JobState enum. */
	// +optional
	State *string `json:"state,omitempty"`

	/* The type of this job, selected from the JobType enum. */
	// +optional
	Type *string `json:"type,omitempty"`
}

func (*DataflowJobStatus) DeepCopy 

func (in *DataflowJobStatus) DeepCopy() *DataflowJobStatus

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new DataflowJobStatus.

func (*DataflowJobStatus) DeepCopyInto 

func (in *DataflowJobStatus) DeepCopyInto(out *DataflowJobStatus)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type FlextemplatejobParameters 

type FlextemplatejobParameters struct {
}

func (*FlextemplatejobParameters) DeepCopy 

func (in *FlextemplatejobParameters) DeepCopy() *FlextemplatejobParameters

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new FlextemplatejobParameters.

func (*FlextemplatejobParameters) DeepCopyInto 

func (in *FlextemplatejobParameters) DeepCopyInto(out *FlextemplatejobParameters)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type FlextemplatejobTransformNameMapping added in v1.107.0 

type FlextemplatejobTransformNameMapping struct {
}

func (*FlextemplatejobTransformNameMapping) DeepCopy added in v1.107.0 

func (in *FlextemplatejobTransformNameMapping) DeepCopy() *FlextemplatejobTransformNameMapping

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new FlextemplatejobTransformNameMapping.

func (*FlextemplatejobTransformNameMapping) DeepCopyInto added in v1.107.0 

func (in *FlextemplatejobTransformNameMapping) DeepCopyInto(out *FlextemplatejobTransformNameMapping)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobParameters 

type JobParameters struct {
}

func (*JobParameters) DeepCopy 

func (in *JobParameters) DeepCopy() *JobParameters

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobParameters.

func (*JobParameters) DeepCopyInto 

func (in *JobParameters) DeepCopyInto(out *JobParameters)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

type JobTransformNameMapping 

type JobTransformNameMapping struct {
}

func (*JobTransformNameMapping) DeepCopy 

func (in *JobTransformNameMapping) DeepCopy() *JobTransformNameMapping

DeepCopy is an autogenerated deepcopy function, copying the receiver, creating a new JobTransformNameMapping.

func (*JobTransformNameMapping) DeepCopyInto 

func (in *JobTransformNameMapping) DeepCopyInto(out *JobTransformNameMapping)

DeepCopyInto is an autogenerated deepcopy function, copying the receiver, writing into out. in must be non-nil.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.