client

Documentation

Index

• type V1
  • func GetV1(ctx context.Context, target string, opts ...grpc.DialOption) (V1, error)

Types

type V1

type V1 interface {
	// ModelInfer performs inference using a specific model.
	ModelInfer(context.Context, *inferencev1.ModelInferRequest, ...grpc.CallOption) (*inferencev1.ModelInferResponse, error)

	// ModelReady checks readiness of a model in the inference server..
	ModelReady(context.Context, *inferencev1.ModelReadyRequest, ...grpc.CallOption) (*inferencev1.ModelReadyResponse, error)

	// ServerReady checks readiness of the inference server.
	ServerReady(context.Context, *inferencev1.ServerReadyRequest, ...grpc.CallOption) (*inferencev1.ServerReadyResponse, error)

	// Close tears down the ClientConn and all underlying connections.
	Close() error
}

ClientV1 is the interface for v1 version of the grpc client.

func GetV1

func GetV1(ctx context.Context, target string, opts ...grpc.DialOption) (V1, error)

GetV1 returns v1 version of the prediction client.