serving

package
v0.12.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Nov 11, 2024 License: Apache-2.0 Imports: 4 Imported by: 3

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type CustomServingJobBuilder

type CustomServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewCustomServingJobBuilder

func NewCustomServingJobBuilder() *CustomServingJobBuilder

func (*CustomServingJobBuilder) Annotations

func (b *CustomServingJobBuilder) Annotations(annotations map[string]string) *CustomServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*CustomServingJobBuilder) Build

func (b *CustomServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*CustomServingJobBuilder) CPU

CPU assign cpu limits,match the option --cpu

func (*CustomServingJobBuilder) Command

Command is used to set job command

func (*CustomServingJobBuilder) DataDirs

DataDirs is used to mount host files to job containers,match option --data-dir

func (*CustomServingJobBuilder) DataSubPathExprs added in v0.9.1

func (b *CustomServingJobBuilder) DataSubPathExprs(exprs map[string]string) *CustomServingJobBuilder

DataSubPathExprs is used to mount k8s pvc subpath to job pods,match option data-subpath-expr

func (*CustomServingJobBuilder) Datas

Datas is used to mount k8s pvc to job pods,match option --data

func (*CustomServingJobBuilder) Devices added in v0.10.0

Devices is used to set chip vendors and count that used for resources, such as amd.com/gpu=1 gpu.intel.com/i915=1,match the option --device

func (*CustomServingJobBuilder) EmptyDirSubPathExprs added in v0.9.2

func (b *CustomServingJobBuilder) EmptyDirSubPathExprs(exprs map[string]string) *CustomServingJobBuilder

func (*CustomServingJobBuilder) EnableIstio

EnableIstio is used to enable istio,match the option --enable-istio

func (*CustomServingJobBuilder) Envs

Envs is used to set env of job containers,match option --env

func (*CustomServingJobBuilder) EnvsFromSecret added in v0.9.16

func (b *CustomServingJobBuilder) EnvsFromSecret(envs map[string]string) *CustomServingJobBuilder

EnvsFromSecret is used to set env of job containers,match option --env-from-secret

func (*CustomServingJobBuilder) ExposeService

ExposeService is used to expose service,match the option --expose-service

func (*CustomServingJobBuilder) GPUCore added in v0.9.1

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*CustomServingJobBuilder) GPUCount

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*CustomServingJobBuilder) GPUMemory

func (b *CustomServingJobBuilder) GPUMemory(memory int) *CustomServingJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*CustomServingJobBuilder) Image

Image is used to set job image,match the option --image

func (*CustomServingJobBuilder) ImagePullPolicy

func (b *CustomServingJobBuilder) ImagePullPolicy(policy string) *CustomServingJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*CustomServingJobBuilder) Labels added in v0.8.7

Labels is used to add labels for job

func (*CustomServingJobBuilder) Memory

Memory assign memory limits,match option --memory

func (*CustomServingJobBuilder) MetricsPort added in v0.8.8

func (b *CustomServingJobBuilder) MetricsPort(port int) *CustomServingJobBuilder

MetricsPort is used to set metrics port,match the option --metrics-port

func (*CustomServingJobBuilder) Name

Name is used to set job name,match option --name

func (*CustomServingJobBuilder) Namespace

func (b *CustomServingJobBuilder) Namespace(namespace string) *CustomServingJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*CustomServingJobBuilder) NodeSelectors

func (b *CustomServingJobBuilder) NodeSelectors(selectors map[string]string) *CustomServingJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*CustomServingJobBuilder) Port

Port is used to set port,match the option --port

func (*CustomServingJobBuilder) Replicas

Replicas is used to set serving job replicas,match the option --replicas

func (*CustomServingJobBuilder) RestfulPort

func (b *CustomServingJobBuilder) RestfulPort(port int) *CustomServingJobBuilder

RestfulPort is used to set restful port,match the option --restful-port

func (*CustomServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*CustomServingJobBuilder) TempDirs added in v0.9.2

func (*CustomServingJobBuilder) Tolerations

func (b *CustomServingJobBuilder) Tolerations(tolerations []string) *CustomServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*CustomServingJobBuilder) Version

Version is used to set serving job version,match the option --version

type DistributedServingJobBuilder added in v0.12.0

type DistributedServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewDistributedServingJobBuilder added in v0.12.0

func NewDistributedServingJobBuilder() *DistributedServingJobBuilder

func (*DistributedServingJobBuilder) Annotations added in v0.12.0

Annotations is used to add annotations for job pods,match option --annotation

func (*DistributedServingJobBuilder) Build added in v0.12.0

func (b *DistributedServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*DistributedServingJobBuilder) CPU added in v0.12.0

CPU assign cpu limits,match the option --cpu

func (*DistributedServingJobBuilder) Command added in v0.12.0

Command is used to set job command

func (*DistributedServingJobBuilder) DataDirs added in v0.12.0

DataDirs is used to mount host files to job containers,match option --data-dir

func (*DistributedServingJobBuilder) DataSubPathExprs added in v0.12.0

DataSubPathExprs is used to mount k8s pvc subpath to job pods,match option data-subpath-expr

func (*DistributedServingJobBuilder) Datas added in v0.12.0

Datas is used to mount k8s pvc to job pods,match option --data

func (*DistributedServingJobBuilder) EmptyDirSubPathExprs added in v0.12.0

func (b *DistributedServingJobBuilder) EmptyDirSubPathExprs(exprs map[string]string) *DistributedServingJobBuilder

func (*DistributedServingJobBuilder) EnableIstio added in v0.12.0

EnableIstio is used to enable istio,match the option --enable-istio

func (*DistributedServingJobBuilder) Envs added in v0.12.0

Envs is used to set env of job containers,match option --env

func (*DistributedServingJobBuilder) EnvsFromSecret added in v0.12.0

EnvsFromSecret is used to set env of job containers,match option --env-from-secret

func (*DistributedServingJobBuilder) ExposeService added in v0.12.0

ExposeService is used to expose service,match the option --expose-service

func (*DistributedServingJobBuilder) GPUCore added in v0.12.0

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*DistributedServingJobBuilder) GPUCount added in v0.12.0

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*DistributedServingJobBuilder) GPUMemory added in v0.12.0

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*DistributedServingJobBuilder) Image added in v0.12.0

Image is used to set job image,match the option --image

func (*DistributedServingJobBuilder) ImagePullPolicy added in v0.12.0

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*DistributedServingJobBuilder) InitBackend added in v0.12.0

InitBackend is used to set init backend,match the option --init-backend

func (*DistributedServingJobBuilder) Labels added in v0.12.0

Labels is used to add labels for job

func (*DistributedServingJobBuilder) MasterCommand added in v0.12.0

MasterCommand is used to set master pods command,match the option --master-command

func (*DistributedServingJobBuilder) MasterCpu added in v0.12.0

MasterCpu is used to set master pods cpu,match the option --master-cpu

func (*DistributedServingJobBuilder) MasterGPUCore added in v0.12.0

MasterGPUCore is used to set master pods gpucore,match the option --master-gpucore

func (*DistributedServingJobBuilder) MasterGPUMemory added in v0.12.0

func (b *DistributedServingJobBuilder) MasterGPUMemory(gpuMemory int) *DistributedServingJobBuilder

MasterGPUMemory is used to set master pods memory,match the option --master-gpumemory

func (*DistributedServingJobBuilder) MasterGpus added in v0.12.0

MasterGpus is used to set master pods gpus,match the option --master-gpus

func (*DistributedServingJobBuilder) MasterMemory added in v0.12.0

MasterMemory is used to set master pods memory,match the option --master-memory

func (*DistributedServingJobBuilder) Masters added in v0.12.0

Masters is used to set master pods number,match the option --masters

func (*DistributedServingJobBuilder) Memory added in v0.12.0

Memory assign memory limits,match option --memory

func (*DistributedServingJobBuilder) MetricsPort added in v0.12.0

MetricsPort is used to set metrics port,match the option --metrics-port

func (*DistributedServingJobBuilder) Name added in v0.12.0

Name is used to set job name,match option --name

func (*DistributedServingJobBuilder) Namespace added in v0.12.0

Namespace is used to set job namespace,match option --namespace

func (*DistributedServingJobBuilder) NodeSelectors added in v0.12.0

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*DistributedServingJobBuilder) Port added in v0.12.0

Port is used to set port,match the option --port

func (*DistributedServingJobBuilder) Replicas added in v0.12.0

Replicas is used to set serving job replicas,match the option --replicas

func (*DistributedServingJobBuilder) RestfulPort added in v0.12.0

RestfulPort is used to set restful port,match the option --restful-port

func (*DistributedServingJobBuilder) Shell added in v0.12.0

Shell is used to set bash or sh

func (*DistributedServingJobBuilder) TempDirs added in v0.12.0

func (*DistributedServingJobBuilder) Tolerations added in v0.12.0

func (b *DistributedServingJobBuilder) Tolerations(tolerations []string) *DistributedServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*DistributedServingJobBuilder) Version added in v0.12.0

Version is used to set serving job version,match the option --version

func (*DistributedServingJobBuilder) WorkerCommand added in v0.12.0

WorkerCommand is used to set worker pods command,match the option --worker-command

func (*DistributedServingJobBuilder) WorkerCpu added in v0.12.0

WorkerCpu is used to set worker pods cpu,match the option --worker-cpu

func (*DistributedServingJobBuilder) WorkerGPUCore added in v0.12.0

WorkerGPUCore is used to set worker pods gpucore,match the option --worker-gpucore

func (*DistributedServingJobBuilder) WorkerGPUMemory added in v0.12.0

func (b *DistributedServingJobBuilder) WorkerGPUMemory(gpuMemory int) *DistributedServingJobBuilder

WorkerGPUMemory is used to set worker pods memory,match the option --worker-gpumemory

func (*DistributedServingJobBuilder) WorkerGpus added in v0.12.0

WorkerGpus is used to set worker pods gpus,match the option --worker-gpus

func (*DistributedServingJobBuilder) WorkerMemory added in v0.12.0

WorkerMemory is used to set worker pods memory,match the option --worker-memory

func (*DistributedServingJobBuilder) Workers added in v0.12.0

Workers is used to set worker pods number,match the option --workers

type Job

type Job struct {
	// contains filtered or unexported fields
}

Job defines the base job

func NewJob

func NewJob(name string, jobType types.ServingJobType, args interface{}) *Job

func (*Job) Args

func (b *Job) Args() interface{}

func (*Job) Name

func (b *Job) Name() string

func (*Job) Type

func (j *Job) Type() types.ServingJobType

type KFServingJobBuilder

type KFServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewKFServingJobBuilder

func NewKFServingJobBuilder() *KFServingJobBuilder

func (*KFServingJobBuilder) Annotations

func (b *KFServingJobBuilder) Annotations(annotations map[string]string) *KFServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*KFServingJobBuilder) Build

func (b *KFServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*KFServingJobBuilder) CPU

CPU assign cpu limits,match the option --cpu

func (*KFServingJobBuilder) CanaryPercent

func (b *KFServingJobBuilder) CanaryPercent(percent int) *KFServingJobBuilder

CanaryPercent is used to set Canary percent,match the option --canary-percent

func (*KFServingJobBuilder) Command

func (b *KFServingJobBuilder) Command(args []string) *KFServingJobBuilder

Command is used to set job command

func (*KFServingJobBuilder) ConfigFiles added in v0.8.9

func (b *KFServingJobBuilder) ConfigFiles(files map[string]string) *KFServingJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*KFServingJobBuilder) DataDirs

func (b *KFServingJobBuilder) DataDirs(volumes map[string]string) *KFServingJobBuilder

DataDirs is used to mount host files to job containers,match option --data-dir

func (*KFServingJobBuilder) Datas

func (b *KFServingJobBuilder) Datas(volumes map[string]string) *KFServingJobBuilder

Datas is used to mount k8s pvc to job pods,match option --data

func (*KFServingJobBuilder) EnableIstio

func (b *KFServingJobBuilder) EnableIstio() *KFServingJobBuilder

EnableIstio is used to enable istio,match the option --enable-istio

func (*KFServingJobBuilder) Envs

Envs is used to set env of job containers,match option --env

func (*KFServingJobBuilder) ExposeService

func (b *KFServingJobBuilder) ExposeService() *KFServingJobBuilder

ExposeService is used to expose service,match the option --expose-service

func (*KFServingJobBuilder) GPUCore added in v0.9.1

func (b *KFServingJobBuilder) GPUCore(core int) *KFServingJobBuilder

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*KFServingJobBuilder) GPUCount

func (b *KFServingJobBuilder) GPUCount(count int) *KFServingJobBuilder

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*KFServingJobBuilder) GPUMemory

func (b *KFServingJobBuilder) GPUMemory(memory int) *KFServingJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*KFServingJobBuilder) Image

Image is used to set job image,match the option --image

func (*KFServingJobBuilder) ImagePullPolicy

func (b *KFServingJobBuilder) ImagePullPolicy(policy string) *KFServingJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*KFServingJobBuilder) Labels added in v0.8.7

func (b *KFServingJobBuilder) Labels(labels map[string]string) *KFServingJobBuilder

Labels is used to add labels for job

func (*KFServingJobBuilder) Memory

func (b *KFServingJobBuilder) Memory(memory string) *KFServingJobBuilder

Memory assign memory limits,match option --memory

func (*KFServingJobBuilder) ModelType

func (b *KFServingJobBuilder) ModelType(modeType string) *KFServingJobBuilder

ModeType is used to set mode type,match the option --mode-type

func (*KFServingJobBuilder) Name

Name is used to set job name,match option --name

func (*KFServingJobBuilder) Namespace

func (b *KFServingJobBuilder) Namespace(namespace string) *KFServingJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*KFServingJobBuilder) NodeSelectors

func (b *KFServingJobBuilder) NodeSelectors(selectors map[string]string) *KFServingJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*KFServingJobBuilder) Port

Port is used to set port,match the option --port

func (*KFServingJobBuilder) Replicas

func (b *KFServingJobBuilder) Replicas(count int) *KFServingJobBuilder

Replicas is used to set serving job replicas,match the option --replicas

func (*KFServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*KFServingJobBuilder) StorageUri

func (b *KFServingJobBuilder) StorageUri(uri string) *KFServingJobBuilder

StorageUri is used to set storage uri,match the option --storage-uri

func (*KFServingJobBuilder) Tolerations

func (b *KFServingJobBuilder) Tolerations(tolerations []string) *KFServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*KFServingJobBuilder) Version

func (b *KFServingJobBuilder) Version(version string) *KFServingJobBuilder

Version is used to set serving job version,match the option --version

type KServeJobBuilder added in v0.9.11

type KServeJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewKServeJobBuilder added in v0.9.11

func NewKServeJobBuilder() *KServeJobBuilder

func (*KServeJobBuilder) Annotations added in v0.9.11

func (b *KServeJobBuilder) Annotations(annotations map[string]string) *KServeJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*KServeJobBuilder) Build added in v0.9.11

func (b *KServeJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*KServeJobBuilder) CPU added in v0.9.11

CPU assign cpu limits,match the option --cpu

func (*KServeJobBuilder) CanaryTrafficPercent added in v0.9.11

func (b *KServeJobBuilder) CanaryTrafficPercent(canaryTrafficPercent int64) *KServeJobBuilder

CanaryTrafficPercent defines the traffic split percentage between the candidate revision and the last ready revision

func (*KServeJobBuilder) Command added in v0.9.11

func (b *KServeJobBuilder) Command(args []string) *KServeJobBuilder

Command is used to set job command

func (*KServeJobBuilder) ConfigFiles added in v0.9.11

func (b *KServeJobBuilder) ConfigFiles(files map[string]string) *KServeJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*KServeJobBuilder) ContainerConcurrency added in v0.9.11

func (b *KServeJobBuilder) ContainerConcurrency(containerConcurrency int64) *KServeJobBuilder

ContainerConcurrency specifies how many requests can be processed concurrently

func (*KServeJobBuilder) DataDirs added in v0.9.11

func (b *KServeJobBuilder) DataDirs(volumes map[string]string) *KServeJobBuilder

DataDirs is used to mount host files to job containers,match option --data-dir

func (*KServeJobBuilder) Datas added in v0.9.11

func (b *KServeJobBuilder) Datas(volumes map[string]string) *KServeJobBuilder

Datas is used to mount k8s pvc to job pods,match option --data

func (*KServeJobBuilder) EnableIstio added in v0.9.11

func (b *KServeJobBuilder) EnableIstio() *KServeJobBuilder

EnableIstio is used to enable istio,match the option --enable-istio

func (*KServeJobBuilder) Envs added in v0.9.11

func (b *KServeJobBuilder) Envs(envs map[string]string) *KServeJobBuilder

Envs is used to set env of job containers,match option --env

func (*KServeJobBuilder) EnvsFromSecret added in v0.9.16

func (b *KServeJobBuilder) EnvsFromSecret(envs map[string]string) *KServeJobBuilder

EnvsFromSecret is used to set env of job containers,match option --env-from-secret

func (*KServeJobBuilder) ExposeService added in v0.9.11

func (b *KServeJobBuilder) ExposeService() *KServeJobBuilder

ExposeService is used to expose service,match the option --expose-service

func (*KServeJobBuilder) GPUCore added in v0.9.11

func (b *KServeJobBuilder) GPUCore(core int) *KServeJobBuilder

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*KServeJobBuilder) GPUCount added in v0.9.11

func (b *KServeJobBuilder) GPUCount(count int) *KServeJobBuilder

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*KServeJobBuilder) GPUMemory added in v0.9.11

func (b *KServeJobBuilder) GPUMemory(memory int) *KServeJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*KServeJobBuilder) Image added in v0.9.11

func (b *KServeJobBuilder) Image(image string) *KServeJobBuilder

Image is used to set job image,match the option --image

func (*KServeJobBuilder) ImagePullPolicy added in v0.9.11

func (b *KServeJobBuilder) ImagePullPolicy(policy string) *KServeJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*KServeJobBuilder) Labels added in v0.9.11

func (b *KServeJobBuilder) Labels(labels map[string]string) *KServeJobBuilder

Labels is used to add labels for job

func (*KServeJobBuilder) MaxReplicas added in v0.9.11

func (b *KServeJobBuilder) MaxReplicas(maxReplicas int) *KServeJobBuilder

MaxReplicas number of replicas for autoscaling.

func (*KServeJobBuilder) Memory added in v0.9.11

func (b *KServeJobBuilder) Memory(memory string) *KServeJobBuilder

Memory assign memory limits,match option --memory

func (*KServeJobBuilder) MinReplicas added in v0.9.11

func (b *KServeJobBuilder) MinReplicas(minReplicas int) *KServeJobBuilder

MinReplicas number of replicas, defaults to 1 but can be set to 0 to enable scale-to-zero.

func (*KServeJobBuilder) ModelFormat added in v0.9.11

func (b *KServeJobBuilder) ModelFormat(modelFormat *types.ModelFormat) *KServeJobBuilder

ModelFormat the ModelFormat being served.

func (*KServeJobBuilder) Name added in v0.9.11

func (b *KServeJobBuilder) Name(name string) *KServeJobBuilder

Name is used to set job name,match option --name

func (*KServeJobBuilder) Namespace added in v0.9.11

func (b *KServeJobBuilder) Namespace(namespace string) *KServeJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*KServeJobBuilder) NodeSelectors added in v0.9.11

func (b *KServeJobBuilder) NodeSelectors(selectors map[string]string) *KServeJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*KServeJobBuilder) Port added in v0.9.11

func (b *KServeJobBuilder) Port(port int) *KServeJobBuilder

Port the port of tcp listening port, default is 8080 in kserve

func (*KServeJobBuilder) ProtocolVersion added in v0.9.11

func (b *KServeJobBuilder) ProtocolVersion(protocolVersion string) *KServeJobBuilder

ProtocolVersion use by the predictor (i.e. v1 or v2 or grpc-v1 or grpc-v2)

func (*KServeJobBuilder) Replicas added in v0.9.11

func (b *KServeJobBuilder) Replicas(count int) *KServeJobBuilder

Replicas is used to set serving job replicas,match the option --replicas

func (*KServeJobBuilder) Runtime added in v0.9.11

func (b *KServeJobBuilder) Runtime(runtime string) *KServeJobBuilder

Runtime specific ClusterServingRuntime/ServingRuntime name to use for deployment.

func (*KServeJobBuilder) RuntimeVersion added in v0.9.11

func (b *KServeJobBuilder) RuntimeVersion(runtimeVersion string) *KServeJobBuilder

RuntimeVersion of the predictor docker image

func (*KServeJobBuilder) ScaleMetric added in v0.9.11

func (b *KServeJobBuilder) ScaleMetric(scaleMetric string) *KServeJobBuilder

ScaleMetric watched by autoscaler. possible values are concurrency, rps, cpu, memory. concurrency, rps are supported via KPA

func (*KServeJobBuilder) ScaleTarget added in v0.9.11

func (b *KServeJobBuilder) ScaleTarget(scaleTarget int) *KServeJobBuilder

ScaleTarget number of replicas for autoscaling.

func (*KServeJobBuilder) Shell added in v0.9.11

func (b *KServeJobBuilder) Shell(shell string) *KServeJobBuilder

Shell is used to set bash or sh

func (*KServeJobBuilder) StorageUri added in v0.9.11

func (b *KServeJobBuilder) StorageUri(uri string) *KServeJobBuilder

StorageUri is used to set storage uri,match the option --storage-uri

func (*KServeJobBuilder) TimeoutSeconds added in v0.9.11

func (b *KServeJobBuilder) TimeoutSeconds(timeoutSeconds int64) *KServeJobBuilder

TimeoutSeconds specifies the number of seconds to wait before timing out a request to the component.

func (*KServeJobBuilder) Tolerations added in v0.9.11

func (b *KServeJobBuilder) Tolerations(tolerations []string) *KServeJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*KServeJobBuilder) Version added in v0.9.11

func (b *KServeJobBuilder) Version(version string) *KServeJobBuilder

Version is used to set serving job version,match the option --version

type SeldonJobBuilder added in v0.8.0

type SeldonJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewSeldonServingJobBuilder added in v0.8.0

func NewSeldonServingJobBuilder() *SeldonJobBuilder

func (*SeldonJobBuilder) Annotations added in v0.8.0

func (b *SeldonJobBuilder) Annotations(annotations map[string]string) *SeldonJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*SeldonJobBuilder) Build added in v0.8.0

func (b *SeldonJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*SeldonJobBuilder) CPU added in v0.8.0

CPU assign cpu limits,match the option --cpu

func (*SeldonJobBuilder) Command added in v0.8.0

func (b *SeldonJobBuilder) Command(args []string) *SeldonJobBuilder

Command is used to set job command

func (*SeldonJobBuilder) ConfigFiles added in v0.8.9

func (b *SeldonJobBuilder) ConfigFiles(files map[string]string) *SeldonJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*SeldonJobBuilder) DataDirs added in v0.8.0

func (b *SeldonJobBuilder) DataDirs(volumes map[string]string) *SeldonJobBuilder

DataDirs is used to mount host files to job containers,match option --data-dir

func (*SeldonJobBuilder) Datas added in v0.8.0

func (b *SeldonJobBuilder) Datas(volumes map[string]string) *SeldonJobBuilder

Datas is used to mount k8s pvc to job pods,match option --data

func (*SeldonJobBuilder) EnableIstio added in v0.8.0

func (b *SeldonJobBuilder) EnableIstio() *SeldonJobBuilder

EnableIstio is used to enable istio,match the option --enable-istio

func (*SeldonJobBuilder) Envs added in v0.8.0

func (b *SeldonJobBuilder) Envs(envs map[string]string) *SeldonJobBuilder

Envs is used to set env of job containers,match option --env

func (*SeldonJobBuilder) ExposeService added in v0.8.0

func (b *SeldonJobBuilder) ExposeService() *SeldonJobBuilder

ExposeService is used to expose service,match the option --expose-service

func (*SeldonJobBuilder) GPUCore added in v0.9.1

func (b *SeldonJobBuilder) GPUCore(core int) *SeldonJobBuilder

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*SeldonJobBuilder) GPUCount added in v0.8.0

func (b *SeldonJobBuilder) GPUCount(count int) *SeldonJobBuilder

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*SeldonJobBuilder) GPUMemory added in v0.8.0

func (b *SeldonJobBuilder) GPUMemory(memory int) *SeldonJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*SeldonJobBuilder) Image added in v0.8.0

func (b *SeldonJobBuilder) Image(image string) *SeldonJobBuilder

Image is used to set job image,match the option --image

func (*SeldonJobBuilder) ImagePullPolicy added in v0.8.0

func (b *SeldonJobBuilder) ImagePullPolicy(policy string) *SeldonJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*SeldonJobBuilder) Implementation added in v0.8.0

func (b *SeldonJobBuilder) Implementation(implementation string) *SeldonJobBuilder

Implementation defines the serving model framework --implementation

func (*SeldonJobBuilder) Labels added in v0.8.7

func (b *SeldonJobBuilder) Labels(labels map[string]string) *SeldonJobBuilder

Labels is used to add labels for job

func (*SeldonJobBuilder) Memory added in v0.8.0

func (b *SeldonJobBuilder) Memory(memory string) *SeldonJobBuilder

Memory assign memory limits,match option --memory

func (*SeldonJobBuilder) ModelUri added in v0.8.0

func (b *SeldonJobBuilder) ModelUri(modelUri string) *SeldonJobBuilder

ModelUri defines the model uri --mode-uri

func (*SeldonJobBuilder) Name added in v0.8.0

func (b *SeldonJobBuilder) Name(name string) *SeldonJobBuilder

Name is used to set job name,match option --name

func (*SeldonJobBuilder) Namespace added in v0.8.0

func (b *SeldonJobBuilder) Namespace(namespace string) *SeldonJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*SeldonJobBuilder) NodeSelectors added in v0.8.0

func (b *SeldonJobBuilder) NodeSelectors(selectors map[string]string) *SeldonJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*SeldonJobBuilder) Replicas added in v0.8.0

func (b *SeldonJobBuilder) Replicas(count int) *SeldonJobBuilder

Replicas is used to set serving job replicas,match the option --replicas

func (*SeldonJobBuilder) Shell added in v0.8.9

func (b *SeldonJobBuilder) Shell(shell string) *SeldonJobBuilder

Shell is used to set bash or sh

func (*SeldonJobBuilder) Tolerations added in v0.8.0

func (b *SeldonJobBuilder) Tolerations(tolerations []string) *SeldonJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*SeldonJobBuilder) Version added in v0.8.0

func (b *SeldonJobBuilder) Version(version string) *SeldonJobBuilder

Version is used to set serving job version,match the option --version

type TFServingJobBuilder

type TFServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewTFServingJobBuilder

func NewTFServingJobBuilder() *TFServingJobBuilder

func (*TFServingJobBuilder) Annotations

func (b *TFServingJobBuilder) Annotations(annotations map[string]string) *TFServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*TFServingJobBuilder) Build

func (b *TFServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*TFServingJobBuilder) CPU

CPU assign cpu limits,match the option --cpu

func (*TFServingJobBuilder) Command

func (b *TFServingJobBuilder) Command(args []string) *TFServingJobBuilder

Command is used to set job command

func (*TFServingJobBuilder) ConfigFiles added in v0.8.9

func (b *TFServingJobBuilder) ConfigFiles(files map[string]string) *TFServingJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*TFServingJobBuilder) DataDirs

func (b *TFServingJobBuilder) DataDirs(volumes map[string]string) *TFServingJobBuilder

DataDirs is used to mount host files to job containers,match option --data-dir

func (*TFServingJobBuilder) DataSubPathExprs added in v0.9.1

func (b *TFServingJobBuilder) DataSubPathExprs(exprs map[string]string) *TFServingJobBuilder

DataSubPathExprs is used to mount k8s pvc subpath to job pods,match option data-subpath-expr

func (*TFServingJobBuilder) Datas

func (b *TFServingJobBuilder) Datas(volumes map[string]string) *TFServingJobBuilder

Datas is used to mount k8s pvc to job pods,match option --data

func (*TFServingJobBuilder) EmptyDirSubPathExprs added in v0.9.2

func (b *TFServingJobBuilder) EmptyDirSubPathExprs(exprs map[string]string) *TFServingJobBuilder

EmptyDirSubPathExprs specify the datasource subpath to mount to the pod by expression

func (*TFServingJobBuilder) EnableIstio

func (b *TFServingJobBuilder) EnableIstio() *TFServingJobBuilder

EnableIstio is used to enable istio,match the option --enable-istio

func (*TFServingJobBuilder) Envs

Envs is used to set env of job containers,match option --env

func (*TFServingJobBuilder) ExposeService

func (b *TFServingJobBuilder) ExposeService() *TFServingJobBuilder

ExposeService is used to expose service,match the option --expose-service

func (*TFServingJobBuilder) GPUCore added in v0.9.1

func (b *TFServingJobBuilder) GPUCore(core int) *TFServingJobBuilder

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*TFServingJobBuilder) GPUCount

func (b *TFServingJobBuilder) GPUCount(count int) *TFServingJobBuilder

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*TFServingJobBuilder) GPUMemory

func (b *TFServingJobBuilder) GPUMemory(memory int) *TFServingJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*TFServingJobBuilder) Image

Image is used to set job image,match the option --image

func (*TFServingJobBuilder) ImagePullPolicy

func (b *TFServingJobBuilder) ImagePullPolicy(policy string) *TFServingJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*TFServingJobBuilder) Labels added in v0.8.7

func (b *TFServingJobBuilder) Labels(labels map[string]string) *TFServingJobBuilder

Labels is used to add labels for job

func (*TFServingJobBuilder) Memory

func (b *TFServingJobBuilder) Memory(memory string) *TFServingJobBuilder

Memory assign memory limits,match option --memory

func (*TFServingJobBuilder) ModelConfigFile

func (b *TFServingJobBuilder) ModelConfigFile(filePath string) *TFServingJobBuilder

ModelConfigFile is used to set model config file,match the option --model-config-file

func (*TFServingJobBuilder) ModelName

func (b *TFServingJobBuilder) ModelName(name string) *TFServingJobBuilder

ModelName is used to set model name,match the option --model-name

func (*TFServingJobBuilder) ModelPath

func (b *TFServingJobBuilder) ModelPath(path string) *TFServingJobBuilder

ModelPath is used to set model path,match the option --model-path

func (*TFServingJobBuilder) MonitoringConfigFile added in v0.8.8

func (b *TFServingJobBuilder) MonitoringConfigFile(filePath string) *TFServingJobBuilder

MonitoringConfigFile is used to set monitoring config file,match the option --monitoring-config-file

func (*TFServingJobBuilder) Name

Name is used to set job name,match option --name

func (*TFServingJobBuilder) Namespace

func (b *TFServingJobBuilder) Namespace(namespace string) *TFServingJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*TFServingJobBuilder) NodeSelectors

func (b *TFServingJobBuilder) NodeSelectors(selectors map[string]string) *TFServingJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*TFServingJobBuilder) Port

Port is used to set port,match the option --port

func (*TFServingJobBuilder) Replicas

func (b *TFServingJobBuilder) Replicas(count int) *TFServingJobBuilder

Replicas is used to set serving job replicas,match the option --replicas

func (*TFServingJobBuilder) RestfulPort

func (b *TFServingJobBuilder) RestfulPort(port int) *TFServingJobBuilder

RestfulPort is used to set restful port,match the option --restful-port

func (*TFServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*TFServingJobBuilder) TempDirs added in v0.9.2

func (b *TFServingJobBuilder) TempDirs(volumes map[string]string) *TFServingJobBuilder

TempDirs specify the deployment empty dir

func (*TFServingJobBuilder) Tolerations

func (b *TFServingJobBuilder) Tolerations(tolerations []string) *TFServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*TFServingJobBuilder) Version

func (b *TFServingJobBuilder) Version(version string) *TFServingJobBuilder

Version is used to set serving job version,match the option --version

func (*TFServingJobBuilder) VersionPolicy

func (b *TFServingJobBuilder) VersionPolicy(policy string) *TFServingJobBuilder

VersionPolicy is used to set version policy,match the option --version-policy

type TRTServingJobBuilder

type TRTServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewTRTServingJobBuilder

func NewTRTServingJobBuilder() *TRTServingJobBuilder

func (*TRTServingJobBuilder) AllowMetrics

func (b *TRTServingJobBuilder) AllowMetrics() *TRTServingJobBuilder

AllowMetrics is enable metric,match the option --allow-meetrics

func (*TRTServingJobBuilder) Annotations

func (b *TRTServingJobBuilder) Annotations(annotations map[string]string) *TRTServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*TRTServingJobBuilder) Build

func (b *TRTServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*TRTServingJobBuilder) CPU

CPU assign cpu limits,match the option --cpu

func (*TRTServingJobBuilder) Command

func (b *TRTServingJobBuilder) Command(args []string) *TRTServingJobBuilder

Command is used to set job command

func (*TRTServingJobBuilder) ConfigFiles added in v0.8.9

func (b *TRTServingJobBuilder) ConfigFiles(files map[string]string) *TRTServingJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*TRTServingJobBuilder) DataDirs

func (b *TRTServingJobBuilder) DataDirs(volumes map[string]string) *TRTServingJobBuilder

DataDirs is used to mount host files to job containers,match option --data-dir

func (*TRTServingJobBuilder) Datas

func (b *TRTServingJobBuilder) Datas(volumes map[string]string) *TRTServingJobBuilder

Datas is used to mount k8s pvc to job pods,match option --data

func (*TRTServingJobBuilder) EnableIstio

func (b *TRTServingJobBuilder) EnableIstio() *TRTServingJobBuilder

EnableIstio is used to enable istio,match the option --enable-istio

func (*TRTServingJobBuilder) Envs

Envs is used to set env of job containers,match option --env

func (*TRTServingJobBuilder) ExposeService

func (b *TRTServingJobBuilder) ExposeService() *TRTServingJobBuilder

ExposeService is used to expose service,match the option --expose-service

func (*TRTServingJobBuilder) GPUCore added in v0.9.1

func (b *TRTServingJobBuilder) GPUCore(core int) *TRTServingJobBuilder

GPUCore is used to set gpu core for the job, match the option --gpucore

func (*TRTServingJobBuilder) GPUCount

func (b *TRTServingJobBuilder) GPUCount(count int) *TRTServingJobBuilder

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*TRTServingJobBuilder) GPUMemory

func (b *TRTServingJobBuilder) GPUMemory(memory int) *TRTServingJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*TRTServingJobBuilder) GrpcPort

func (b *TRTServingJobBuilder) GrpcPort(port int) *TRTServingJobBuilder

RestfulPort is used to set restful port,match the option --restful-port

func (*TRTServingJobBuilder) HttpPort

func (b *TRTServingJobBuilder) HttpPort(port int) *TRTServingJobBuilder

Port is used to set port,match the option --port

func (*TRTServingJobBuilder) Image

Image is used to set job image,match the option --image

func (*TRTServingJobBuilder) ImagePullPolicy

func (b *TRTServingJobBuilder) ImagePullPolicy(policy string) *TRTServingJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*TRTServingJobBuilder) Labels added in v0.8.7

func (b *TRTServingJobBuilder) Labels(labels map[string]string) *TRTServingJobBuilder

Labels is used to add labels for job

func (*TRTServingJobBuilder) Memory

Memory assign memory limits,match option --memory

func (*TRTServingJobBuilder) MetricsPort

func (b *TRTServingJobBuilder) MetricsPort(port int) *TRTServingJobBuilder

MetricsPort is used to set metrics port,match the option --metric-port

func (*TRTServingJobBuilder) ModelStore

func (b *TRTServingJobBuilder) ModelStore(store string) *TRTServingJobBuilder

ModelStore is used to set model store,match the option --model-store

func (*TRTServingJobBuilder) Name

Name is used to set job name,match option --name

func (*TRTServingJobBuilder) Namespace

func (b *TRTServingJobBuilder) Namespace(namespace string) *TRTServingJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*TRTServingJobBuilder) NodeSelectors

func (b *TRTServingJobBuilder) NodeSelectors(selectors map[string]string) *TRTServingJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*TRTServingJobBuilder) Replicas

func (b *TRTServingJobBuilder) Replicas(count int) *TRTServingJobBuilder

Replicas is used to set serving job replicas,match the option --replicas

func (*TRTServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*TRTServingJobBuilder) Tolerations

func (b *TRTServingJobBuilder) Tolerations(tolerations []string) *TRTServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*TRTServingJobBuilder) Version

func (b *TRTServingJobBuilder) Version(version string) *TRTServingJobBuilder

Version is used to set serving job version,match the option --version

type TrafficRouterBuilder

type TrafficRouterBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewTrafficRouterBuilder

func NewTrafficRouterBuilder() *TrafficRouterBuilder

func (*TrafficRouterBuilder) Build

Build is used to build the traffic router split args

func (*TrafficRouterBuilder) Name

Name is used to set job name,match option --name

func (*TrafficRouterBuilder) Namespace

func (b *TrafficRouterBuilder) Namespace(namespace string) *TrafficRouterBuilder

Namespace is used to set job namespace,match option --namespace

func (*TrafficRouterBuilder) VersionWeight

VersionWeight is used to set version weight

type TritonServingJobBuilder added in v0.8.5

type TritonServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewTritonServingJobBuilder added in v0.8.5

func NewTritonServingJobBuilder() *TritonServingJobBuilder

func (*TritonServingJobBuilder) AllowMetrics added in v0.8.5

AllowMetrics is enable metric,match the option --allow-metrics

func (*TritonServingJobBuilder) Annotations added in v0.8.5

func (b *TritonServingJobBuilder) Annotations(annotations map[string]string) *TritonServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*TritonServingJobBuilder) Build added in v0.8.5

func (b *TritonServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*TritonServingJobBuilder) CPU added in v0.8.5

CPU assign cpu limits,match the option --cpu

func (*TritonServingJobBuilder) Command added in v0.8.5

Command is used to set job command

func (*TritonServingJobBuilder) ConfigFiles added in v0.8.9

func (b *TritonServingJobBuilder) ConfigFiles(files map[string]string) *TritonServingJobBuilder

ConfigFiles is used to mapping config files form local to job containers,match option --config-file

func (*TritonServingJobBuilder) DataDirs added in v0.8.5

DataDirs is used to mount host files to job containers,match option --data-dir

func (*TritonServingJobBuilder) DataSubPathExprs added in v0.9.1

func (b *TritonServingJobBuilder) DataSubPathExprs(exprs map[string]string) *TritonServingJobBuilder

DataSubPathExprs is used to mount k8s pvc subpath to job pods,match option data-subpath-expr

func (*TritonServingJobBuilder) Datas added in v0.8.5

Datas is used to mount k8s pvc to job pods,match option --data

func (*TritonServingJobBuilder) EmptyDirSubPathExprs added in v0.9.2

func (b *TritonServingJobBuilder) EmptyDirSubPathExprs(exprs map[string]string) *TritonServingJobBuilder

EmptyDirSubPathExprs specify the datasource subpath to mount to the pod by expression

func (*TritonServingJobBuilder) EnableIstio added in v0.8.5

EnableIstio is used to enable istio,match the option --enable-istio

func (*TritonServingJobBuilder) Envs added in v0.8.5

Envs is used to set env of job containers,match option --env

func (*TritonServingJobBuilder) EnvsFromSecret added in v0.9.16

func (b *TritonServingJobBuilder) EnvsFromSecret(envs map[string]string) *TritonServingJobBuilder

EnvsFromSecret is used to set env of job containers,match option --env-from-secret

func (*TritonServingJobBuilder) ExposeService added in v0.8.5

ExposeService is used to expose service,match the option --expose-service

func (*TritonServingJobBuilder) GPUCore added in v0.9.1

GPUCore is used to set gpu core for the job,match the option --gpucore

func (*TritonServingJobBuilder) GPUCount added in v0.8.5

GPUCount is used to set count of gpu for the job,match the option --gpus

func (*TritonServingJobBuilder) GPUMemory added in v0.8.5

func (b *TritonServingJobBuilder) GPUMemory(memory int) *TritonServingJobBuilder

GPUMemory is used to set gpu memory for the job,match the option --gpumemory

func (*TritonServingJobBuilder) GrpcPort added in v0.8.5

RestfulPort is used to set restful port,match the option --restful-port

func (*TritonServingJobBuilder) HttpPort added in v0.8.5

Port is used to set port,match the option --port

func (*TritonServingJobBuilder) Image added in v0.8.5

Image is used to set job image,match the option --image

func (*TritonServingJobBuilder) ImagePullPolicy added in v0.8.5

func (b *TritonServingJobBuilder) ImagePullPolicy(policy string) *TritonServingJobBuilder

ImagePullPolicy is used to set image pull policy,match the option --image-pull-policy

func (*TritonServingJobBuilder) Labels added in v0.8.7

Labels is used to add labels for job

func (*TritonServingJobBuilder) Memory added in v0.8.5

Memory assign memory limits,match option --memory

func (*TritonServingJobBuilder) MetricsPort added in v0.8.5

func (b *TritonServingJobBuilder) MetricsPort(port int) *TritonServingJobBuilder

MetricsPort is used to set metrics port,match the option --metric-port

func (*TritonServingJobBuilder) ModelRepository added in v0.8.5

func (b *TritonServingJobBuilder) ModelRepository(repository string) *TritonServingJobBuilder

ModelRepository is used to set model store,match the option --model-repository

func (*TritonServingJobBuilder) Name added in v0.8.5

Name is used to set job name,match option --name

func (*TritonServingJobBuilder) Namespace added in v0.8.5

func (b *TritonServingJobBuilder) Namespace(namespace string) *TritonServingJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*TritonServingJobBuilder) NodeSelectors added in v0.8.5

func (b *TritonServingJobBuilder) NodeSelectors(selectors map[string]string) *TritonServingJobBuilder

NodeSelectors is used to set node selectors for scheduling job,match option --selector

func (*TritonServingJobBuilder) Replicas added in v0.8.5

Replicas is used to set serving job replicas,match the option --replicas

func (*TritonServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*TritonServingJobBuilder) TempDirs added in v0.9.2

TempDirs specify the deployment empty dir

func (*TritonServingJobBuilder) Tolerations added in v0.8.5

func (b *TritonServingJobBuilder) Tolerations(tolerations []string) *TritonServingJobBuilder

Tolerations is used to set tolerations for tolerate nodes,match option --toleration

func (*TritonServingJobBuilder) Version added in v0.8.5

Version is used to set serving job version,match the option --version

type UpdateCustomServingJobBuilder added in v0.8.9

type UpdateCustomServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewUpdateCustomServingJobBuilder added in v0.8.9

func NewUpdateCustomServingJobBuilder() *UpdateCustomServingJobBuilder

func (*UpdateCustomServingJobBuilder) Annotations added in v0.9.1

Annotations is used to add annotations for job pods,match option --annotation

func (*UpdateCustomServingJobBuilder) Build added in v0.8.9

func (b *UpdateCustomServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*UpdateCustomServingJobBuilder) Command added in v0.8.9

Command is used to set job command

func (*UpdateCustomServingJobBuilder) Envs added in v0.8.9

Envs is used to set env of job containers,match option --env

func (*UpdateCustomServingJobBuilder) Image added in v0.8.9

Image is used to set job image,match the option --image

func (*UpdateCustomServingJobBuilder) Labels added in v0.9.1

Labels is used to add labels for job

func (*UpdateCustomServingJobBuilder) Name added in v0.8.9

Name is used to set job name,match option --name

func (*UpdateCustomServingJobBuilder) Namespace added in v0.8.9

Namespace is used to set job namespace,match option --namespace

func (*UpdateCustomServingJobBuilder) NodeSelectors added in v0.9.13

NodeSelectors is used to set node selectors for scheduling job, match option --selector

func (*UpdateCustomServingJobBuilder) Replicas added in v0.8.9

Replicas is used to set serving job replicas,match the option --replicas

func (*UpdateCustomServingJobBuilder) Tolerations added in v0.9.13

Tolerations are used to set tolerations for tolerate nodes, match option --toleration

func (*UpdateCustomServingJobBuilder) Version added in v0.9.13

Version is used to set serving job version, match the option --version

type UpdateDistributedServingJobBuilder added in v0.12.0

type UpdateDistributedServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewUpdateDistributedServingJobBuilder added in v0.12.0

func NewUpdateDistributedServingJobBuilder() *UpdateDistributedServingJobBuilder

func (*UpdateDistributedServingJobBuilder) Annotations added in v0.12.0

Annotations is used to add annotations for job pods,match option --annotation

func (*UpdateDistributedServingJobBuilder) Build added in v0.12.0

Build is used to build the job

func (*UpdateDistributedServingJobBuilder) Command added in v0.12.0

Command is used to set job command

func (*UpdateDistributedServingJobBuilder) Envs added in v0.12.0

Envs is used to set env of job containers,match option --env

func (*UpdateDistributedServingJobBuilder) Image added in v0.12.0

Image is used to set job image,match the option --image

func (*UpdateDistributedServingJobBuilder) Labels added in v0.12.0

Labels is used to add labels for job

func (*UpdateDistributedServingJobBuilder) MasterCommand added in v0.12.0

MasterCommand is used to set master pods command,match the option --master-command

func (*UpdateDistributedServingJobBuilder) MasterCpu added in v0.12.0

MasterCpu is used to set master pods cpu,match the option --master-cpu

func (*UpdateDistributedServingJobBuilder) MasterGPUCore added in v0.12.0

MasterGPUCore is used to set master pods gpucore,match the option --master-gpucore

func (*UpdateDistributedServingJobBuilder) MasterGPUMemory added in v0.12.0

MasterGPUMemory is used to set master pods memory,match the option --master-gpumemory

func (*UpdateDistributedServingJobBuilder) MasterGpus added in v0.12.0

MasterGpus is used to set master pods gpus,match the option --master-gpus

func (*UpdateDistributedServingJobBuilder) MasterMemory added in v0.12.0

MasterMemory is used to set master pods memory,match the option --master-memory

func (*UpdateDistributedServingJobBuilder) Name added in v0.12.0

Name is used to set job name,match option --name

func (*UpdateDistributedServingJobBuilder) Namespace added in v0.12.0

Namespace is used to set job namespace,match option --namespace

func (*UpdateDistributedServingJobBuilder) NodeSelectors added in v0.12.0

NodeSelectors is used to set node selectors for scheduling job, match option --selector

func (*UpdateDistributedServingJobBuilder) Replicas added in v0.12.0

Replicas is used to set serving job replicas,match the option --replicas

func (*UpdateDistributedServingJobBuilder) Tolerations added in v0.12.0

Tolerations are used to set tolerations for tolerate nodes, match option --toleration

func (*UpdateDistributedServingJobBuilder) Version added in v0.12.0

Version is used to set serving job version, match the option --version

func (*UpdateDistributedServingJobBuilder) WorkerCommand added in v0.12.0

WorkerCommand is used to set worker pods command,match the option --worker-command

func (*UpdateDistributedServingJobBuilder) WorkerCpu added in v0.12.0

WorkerCpu is used to set worker pods cpu,match the option --worker-cpu

func (*UpdateDistributedServingJobBuilder) WorkerGPUCore added in v0.12.0

WorkerGPUCore is used to set worker pods gpucore,match the option --worker-gpucore

func (*UpdateDistributedServingJobBuilder) WorkerGPUMemory added in v0.12.0

WorkerGPUMemory is used to set worker pods memory,match the option --worker-gpumemory

func (*UpdateDistributedServingJobBuilder) WorkerGpus added in v0.12.0

WorkerGpus is used to set worker pods gpus,match the option --worker-gpus

func (*UpdateDistributedServingJobBuilder) WorkerMemory added in v0.12.0

WorkerMemory is used to set worker pods memory,match the option --worker-memory

func (*UpdateDistributedServingJobBuilder) Workers added in v0.12.0

Workers is used to set worker pods number,match the option --workers

type UpdateKServeJobBuilder added in v0.9.11

type UpdateKServeJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewUpdateKServeJobBuilder added in v0.9.11

func NewUpdateKServeJobBuilder() *UpdateKServeJobBuilder

func (*UpdateKServeJobBuilder) Annotations added in v0.9.11

func (b *UpdateKServeJobBuilder) Annotations(annotations map[string]string) *UpdateKServeJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*UpdateKServeJobBuilder) Build added in v0.9.11

func (b *UpdateKServeJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*UpdateKServeJobBuilder) CanaryTrafficPercent added in v0.9.11

func (b *UpdateKServeJobBuilder) CanaryTrafficPercent(canaryTrafficPercent int64) *UpdateKServeJobBuilder

CanaryTrafficPercent defines the traffic split percentage between the candidate revision and the last ready revision

func (*UpdateKServeJobBuilder) Command added in v0.9.11

Command is used to set job command

func (*UpdateKServeJobBuilder) ContainerConcurrency added in v0.9.11

func (b *UpdateKServeJobBuilder) ContainerConcurrency(containerConcurrency int64) *UpdateKServeJobBuilder

ContainerConcurrency specifies how many requests can be processed concurrently

func (*UpdateKServeJobBuilder) Envs added in v0.9.11

Envs is used to set env of job containers,match option --env

func (*UpdateKServeJobBuilder) Image added in v0.9.11

Image is used to set job image,match the option --image

func (*UpdateKServeJobBuilder) Labels added in v0.9.11

Labels is used to add labels for job

func (*UpdateKServeJobBuilder) MaxReplicas added in v0.9.11

func (b *UpdateKServeJobBuilder) MaxReplicas(maxReplicas int) *UpdateKServeJobBuilder

MaxReplicas number of replicas for autoscaling.

func (*UpdateKServeJobBuilder) MinReplicas added in v0.9.11

func (b *UpdateKServeJobBuilder) MinReplicas(minReplicas int) *UpdateKServeJobBuilder

MinReplicas number of replicas, defaults to 1 but can be set to 0 to enable scale-to-zero.

func (*UpdateKServeJobBuilder) ModelFormat added in v0.9.11

func (b *UpdateKServeJobBuilder) ModelFormat(modelFormat *types.ModelFormat) *UpdateKServeJobBuilder

ModelFormat the ModelFormat being served.

func (*UpdateKServeJobBuilder) Name added in v0.9.11

Name is used to set job name,match option --name

func (*UpdateKServeJobBuilder) Namespace added in v0.9.11

func (b *UpdateKServeJobBuilder) Namespace(namespace string) *UpdateKServeJobBuilder

Namespace is used to set job namespace,match option --namespace

func (*UpdateKServeJobBuilder) Port added in v0.9.11

Port the port of tcp listening port, default is 8080 in kserve

func (*UpdateKServeJobBuilder) ProtocolVersion added in v0.9.11

func (b *UpdateKServeJobBuilder) ProtocolVersion(protocolVersion string) *UpdateKServeJobBuilder

ProtocolVersion use by the predictor (i.e. v1 or v2 or grpc-v1 or grpc-v2)

func (*UpdateKServeJobBuilder) Replicas added in v0.9.11

Replicas is used to set serving job replicas,match the option --replicas

func (*UpdateKServeJobBuilder) Runtime added in v0.9.11

Runtime specific ClusterServingRuntime/ServingRuntime name to use for deployment.

func (*UpdateKServeJobBuilder) RuntimeVersion added in v0.9.11

func (b *UpdateKServeJobBuilder) RuntimeVersion(runtimeVersion string) *UpdateKServeJobBuilder

RuntimeVersion of the predictor docker image

func (*UpdateKServeJobBuilder) ScaleMetric added in v0.9.11

func (b *UpdateKServeJobBuilder) ScaleMetric(scaleMetric string) *UpdateKServeJobBuilder

ScaleMetric watched by autoscaler. possible values are concurrency, rps, cpu, memory. concurrency, rps are supported via KPA

func (*UpdateKServeJobBuilder) ScaleTarget added in v0.9.11

func (b *UpdateKServeJobBuilder) ScaleTarget(scaleTarget int) *UpdateKServeJobBuilder

ScaleTarget number of replicas for autoscaling.

func (*UpdateKServeJobBuilder) StorageUri added in v0.9.11

StorageUri is used to set storage uri,match the option --storage-uri

func (*UpdateKServeJobBuilder) TimeoutSeconds added in v0.9.11

func (b *UpdateKServeJobBuilder) TimeoutSeconds(timeoutSeconds int64) *UpdateKServeJobBuilder

TimeoutSeconds specifies the number of seconds to wait before timing out a request to the component.

func (*UpdateKServeJobBuilder) Version added in v0.9.13

Version is used to set serving job version, match the option --version

type UpdateTFServingJobBuilder added in v0.8.9

type UpdateTFServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewUpdateTFServingJobBuilder added in v0.8.9

func NewUpdateTFServingJobBuilder() *UpdateTFServingJobBuilder

func (*UpdateTFServingJobBuilder) Annotations added in v0.9.1

func (b *UpdateTFServingJobBuilder) Annotations(annotations map[string]string) *UpdateTFServingJobBuilder

Annotations is used to add annotations for job pods,match option --annotation

func (*UpdateTFServingJobBuilder) Build added in v0.8.9

func (b *UpdateTFServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*UpdateTFServingJobBuilder) Command added in v0.8.9

Command is used to set job command

func (*UpdateTFServingJobBuilder) Envs added in v0.8.9

Envs is used to set env of job containers,match option --env

func (*UpdateTFServingJobBuilder) Image added in v0.8.9

Image is used to set job image,match the option --image

func (*UpdateTFServingJobBuilder) Labels added in v0.9.1

Labels is used to add labels for job

func (*UpdateTFServingJobBuilder) ModelConfigFile added in v0.8.9

func (b *UpdateTFServingJobBuilder) ModelConfigFile(filePath string) *UpdateTFServingJobBuilder

ModelConfigFile is used to set model config file,match the option --model-config-file

func (*UpdateTFServingJobBuilder) ModelName added in v0.8.9

ModelName is used to set model name,match the option --model-name

func (*UpdateTFServingJobBuilder) ModelPath added in v0.8.9

ModelPath is used to set model path,match the option --model-path

func (*UpdateTFServingJobBuilder) MonitoringConfigFile added in v0.8.9

func (b *UpdateTFServingJobBuilder) MonitoringConfigFile(filePath string) *UpdateTFServingJobBuilder

MonitoringConfigFile is used to set monitoring config file,match the option --monitoring-config-file

func (*UpdateTFServingJobBuilder) Name added in v0.8.9

Name is used to set job name,match option --name

func (*UpdateTFServingJobBuilder) Namespace added in v0.8.9

Namespace is used to set job namespace,match option --namespace

func (*UpdateTFServingJobBuilder) Replicas added in v0.8.9

Replicas is used to set serving job replicas,match the option --replicas

func (*UpdateTFServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*UpdateTFServingJobBuilder) Version added in v0.8.9

Version is used to set serving job version,match the option --version

type UpdateTritonServingJobBuilder added in v0.8.9

type UpdateTritonServingJobBuilder struct {
	argsbuilder.ArgsBuilder
	// contains filtered or unexported fields
}

func NewUpdateTritonServingJobBuilder added in v0.8.9

func NewUpdateTritonServingJobBuilder() *UpdateTritonServingJobBuilder

func (*UpdateTritonServingJobBuilder) AllowMetrics added in v0.8.9

AllowMetrics is enable metric,match the option --allow-metrics

func (*UpdateTritonServingJobBuilder) Annotations added in v0.9.1

Annotations is used to add annotations for job pods,match option --annotation

func (*UpdateTritonServingJobBuilder) Build added in v0.8.9

func (b *UpdateTritonServingJobBuilder) Build() (*Job, error)

Build is used to build the job

func (*UpdateTritonServingJobBuilder) Command added in v0.8.9

Command is used to set job command

func (*UpdateTritonServingJobBuilder) Envs added in v0.8.9

Envs is used to set env of job containers,match option --env

func (*UpdateTritonServingJobBuilder) Image added in v0.8.9

Image is used to set job image,match the option --image

func (*UpdateTritonServingJobBuilder) Labels added in v0.9.1

Labels is used to add labels for job

func (*UpdateTritonServingJobBuilder) ModelRepository added in v0.8.9

func (b *UpdateTritonServingJobBuilder) ModelRepository(modelRepository string) *UpdateTritonServingJobBuilder

ModelRepository is used to set model store,match the option --model-repository

func (*UpdateTritonServingJobBuilder) Name added in v0.8.9

Name is used to set job name,match option --name

func (*UpdateTritonServingJobBuilder) Namespace added in v0.8.9

Namespace is used to set job namespace,match option --namespace

func (*UpdateTritonServingJobBuilder) Replicas added in v0.8.9

Replicas is used to set serving job replicas,match the option --replicas

func (*UpdateTritonServingJobBuilder) Shell added in v0.8.9

Shell is used to set bash or sh

func (*UpdateTritonServingJobBuilder) Version added in v0.8.9

Version is used to set serving job version,match the option --version

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL