modelsyncer

Documentation

Index

• type ModelManager
• type S
  • func New(mm ModelManager, s3Client s3Client, miClient modelClient) (*S, error)
  • func (s *S) ListInProgressModels() []string
  • func (s *S) ListSyncedModelIDs(ctx context.Context) []string
  • func (s *S) PullModel(ctx context.Context, modelID string) error

Types

type ModelManager

type ModelManager interface {
	CreateNewModelOfGGUF(modelName string, spec *ollama.ModelSpec) error
	DownloadAndCreateNewModel(ctx context.Context, modelName string, resp *mv1.GetBaseModelPathResponse) error
	UpdateModelTemplateToLatest(modelname string) error
}

ModelManager is an interface for managing models.

type S

type S struct {
	// contains filtered or unexported fields
}

S is a syncer.

func New

func New(
	mm ModelManager,
	s3Client s3Client,
	miClient modelClient,
) (*S, error)

New creates a syncer..

func (*S) ListInProgressModels

func (s *S) ListInProgressModels() []string

ListInProgressModels lists all models that are in progress of registration.x

func (*S) ListSyncedModelIDs

func (s *S) ListSyncedModelIDs(ctx context.Context) []string

ListSyncedModelIDs lists all models that have been synced.

func (*S) PullModel

func (s *S) PullModel(ctx context.Context, modelID string) error

PullModel downloads and registers a model from model manager.