legacy

Documentation

Index

• Variables
• func RegisterInferenceWorkerServiceServer(s grpc.ServiceRegistrar, srv InferenceWorkerServiceServer)
• type InferenceWorkerServiceClient
  • func NewInferenceWorkerServiceClient(cc grpc.ClientConnInterface) InferenceWorkerServiceClient
• type InferenceWorkerServiceServer
• type InferenceWorkerService_ProcessTasksClient
• type InferenceWorkerService_ProcessTasksServer
• type UnimplementedInferenceWorkerServiceServer
  • func (UnimplementedInferenceWorkerServiceServer) ProcessTasks(InferenceWorkerService_ProcessTasksServer) error
• type UnsafeInferenceWorkerServiceServer

Variables

var File_api_v1_legacy_inference_server_worker_proto protoreflect.FileDescriptor

var InferenceWorkerService_ServiceDesc = grpc.ServiceDesc{
	ServiceName: "llmoperator.inference.server.v1.InferenceWorkerService",
	HandlerType: (*InferenceWorkerServiceServer)(nil),
	Methods:     []grpc.MethodDesc{},
	Streams: []grpc.StreamDesc{
		{
			StreamName:    "ProcessTasks",
			Handler:       _InferenceWorkerService_ProcessTasks_Handler,
			ServerStreams: true,
			ClientStreams: true,
		},
	},
	Metadata: "api/v1/legacy/inference_server_worker.proto",
}

InferenceWorkerService_ServiceDesc is the grpc.ServiceDesc for InferenceWorkerService service. It's only intended for direct use with grpc.RegisterService, and not to be introspected or modified (even as a copy)

Functions

func RegisterInferenceWorkerServiceServer

func RegisterInferenceWorkerServiceServer(s grpc.ServiceRegistrar, srv InferenceWorkerServiceServer)

Types

type InferenceWorkerServiceClient

type InferenceWorkerServiceClient interface {
	ProcessTasks(ctx context.Context, opts ...grpc.CallOption) (InferenceWorkerService_ProcessTasksClient, error)
}

InferenceWorkerServiceClient is the client API for InferenceWorkerService service.

For semantics around ctx use and closing/ending streaming RPCs, please refer to https://pkg.go.dev/google.golang.org/grpc/?tab=doc#ClientConn.NewStream.

func NewInferenceWorkerServiceClient

func NewInferenceWorkerServiceClient(cc grpc.ClientConnInterface) InferenceWorkerServiceClient

type InferenceWorkerServiceServer

type InferenceWorkerServiceServer interface {
	ProcessTasks(InferenceWorkerService_ProcessTasksServer) error
	// contains filtered or unexported methods
}

InferenceWorkerServiceServer is the server API for InferenceWorkerService service. All implementations must embed UnimplementedInferenceWorkerServiceServer for forward compatibility

type InferenceWorkerService_ProcessTasksClient

type InferenceWorkerService_ProcessTasksClient interface {
	Send(*v1.ProcessTasksRequest) error
	Recv() (*v1.ProcessTasksResponse, error)
	grpc.ClientStream
}

type InferenceWorkerService_ProcessTasksServer

type InferenceWorkerService_ProcessTasksServer interface {
	Send(*v1.ProcessTasksResponse) error
	Recv() (*v1.ProcessTasksRequest, error)
	grpc.ServerStream
}

type UnimplementedInferenceWorkerServiceServer

type UnimplementedInferenceWorkerServiceServer struct {
}

UnimplementedInferenceWorkerServiceServer must be embedded to have forward compatible implementations.

func (UnimplementedInferenceWorkerServiceServer) ProcessTasks

func (UnimplementedInferenceWorkerServiceServer) ProcessTasks(InferenceWorkerService_ProcessTasksServer) error

type UnsafeInferenceWorkerServiceServer

type UnsafeInferenceWorkerServiceServer interface {
	// contains filtered or unexported methods
}

UnsafeInferenceWorkerServiceServer may be embedded to opt out of forward compatibility for this service. Use of this interface is not recommended, as added methods to InferenceWorkerServiceServer will result in compilation errors.