server

Documentation

Index

• Constants
• type Config
• type RequestHandler
  • func NewServerForLanguageModeling(predictor languagemodeling.Interface) RequestHandler
  • func NewServerForQuestionAnswering(engine questionanswering.Interface) RequestHandler
  • func NewServerForTextClassification(classifier textclassification.Interface) RequestHandler
  • func NewServerForTextEncoding(encoder textencoding.Interface) RequestHandler
  • func NewServerForTextGeneration(generator textgeneration.Interface) RequestHandler
  • func NewServerForTokenClassification(classifier tokenclassification.Interface) RequestHandler
  • func NewServerForZeroShotClassification(classifier zeroshotclassifier.Interface) RequestHandler
  • func ResolveRequestHandler(model any) (RequestHandler, error)
• type Server
  • func New(conf *Config, handler RequestHandler) *Server
  • func (s *Server) ClientAddr() string
  • func (s *Server) ReadyForConnections(dur time.Duration) bool
  • func (s *Server) Start(ctx context.Context) error

Constants

const (
	// DefaultNetwork is the default network.
	DefaultNetwork = "tcp4"
	// DefaultAddress is the default address.
	DefaultAddress = ":8080"
)

Types

type Config

type Config struct {
	Network        string
	Address        string
	AllowedOrigins []string
	TLSEnabled     bool
	TLSCert        string
	TLSKey         string
}

Config is the configuration for the server.

type RequestHandler

type RequestHandler interface {
	RegisterServer(grpc.ServiceRegistrar) error
	RegisterHandlerServer(context.Context, *runtime.ServeMux) error
}

RequestHandler is implemented by any task-specific service that can be registered in the main Server.

func NewServerForLanguageModeling

func NewServerForLanguageModeling(predictor languagemodeling.Interface) RequestHandler

func NewServerForQuestionAnswering

func NewServerForQuestionAnswering(engine questionanswering.Interface) RequestHandler

func NewServerForTextClassification

func NewServerForTextClassification(classifier textclassification.Interface) RequestHandler

func NewServerForTextEncoding

func NewServerForTextEncoding(encoder textencoding.Interface) RequestHandler

func NewServerForTextGeneration

func NewServerForTextGeneration(generator textgeneration.Interface) RequestHandler

func NewServerForTokenClassification

func NewServerForTokenClassification(classifier tokenclassification.Interface) RequestHandler

func NewServerForZeroShotClassification

func NewServerForZeroShotClassification(classifier zeroshotclassifier.Interface) RequestHandler

func ResolveRequestHandler

func ResolveRequestHandler(model any) (RequestHandler, error)

ResolveRequestHandler instantiates a new task-server based on the model.

type Server

type Server struct {
	// contains filtered or unexported fields
}

Server is a server that provides gRPC and HTTP/2 APIs.

func New

func New(conf *Config, handler RequestHandler) *Server

New creates a new server.

func (*Server) ClientAddr

func (s *Server) ClientAddr() string

ClientAddr returns the Address used to connect clients (without the network). Helpful in testing when we designate a random port (0).

func (*Server) ReadyForConnections

func (s *Server) ReadyForConnections(dur time.Duration) bool

ReadyForConnections returns `true` if the server is ready to accept requests. If after the duration `dur` the server is still not ready, returns `false`.

func (*Server) Start

func (s *Server) Start(ctx context.Context) error

Start up the server and block until the context is done.