tfmodel

Documentation

Index

• Variables
• func Dictionary(session *tf.Session, graph *tf.Graph, signature *domain.Signature) (*common.Dictionary, error)
• func DiscoverDictionary(session *tf.Session, graph *tf.Graph, layers []string) (*common.Dictionary, error)
• func Export(session *tf.Session, graph *tf.Graph, name string) (interface{}, error)
• func MatchOperation(graph *tf.Graph, name string) string
• func RunExport(session *tf.Session, exportOp *tf.Operation) (interface{}, error)
• type Evaluator
  • func NewEvaluator(id string, signature *domain.Signature, session *tf.Session) *Evaluator
  • func (e *Evaluator) Close() error
  • func (e *Evaluator) Evaluate(params []interface{}) ([]interface{}, error)
• type Runner
• type Service
  • func NewService(cfg *config.Model, fs afs.Service, metrics *gmetric.Service, ...) *Service
  • func (s *Service) Close() error
  • func (s *Service) Dictionary() *common.Dictionary
  • func (s *Service) Inputs() map[string]*domain.Input
  • func (s *Service) Predict(ctx context.Context, params []interface{}) ([]interface{}, error)
  • func (s *Service) ReloadIfNeeded(ctx context.Context) error
  • func (s *Service) Signature() *domain.Signature
  • func (s *Service) Stats(r map[string]interface{})

Variables

var TFSessionPanicDuration time.Duration = 1 * time.Minute

Functions

func Dictionary

func Dictionary(session *tf.Session, graph *tf.Graph, signature *domain.Signature) (*common.Dictionary, error)

Dictionary uses domain.Signature to determine which inputs should have an encoding lookup from the Tensorflow graph. TODO pull out *domain.Signature, just use a slice of something.

func DiscoverDictionary

func DiscoverDictionary(session *tf.Session, graph *tf.Graph, layers []string) (*common.Dictionary, error)

DiscoverDictionary extracts vocabulary from from best guessed layer and operations.

func Export

func Export(session *tf.Session, graph *tf.Graph, name string) (interface{}, error)

Export attempts to pull the embedded lookup table from the Tensorflow graph.

func MatchOperation

func MatchOperation(graph *tf.Graph, name string) string

MatchOperation will attempt to locate an LookupTableExportV2 operation that is associated to the provided name.

func RunExport

func RunExport(session *tf.Session, exportOp *tf.Operation) (interface{}, error)

RunExport runs export

Types

type Evaluator

type Evaluator struct {
	domain.Signature
	// contains filtered or unexported fields
}

Evaluator represents evaluator

func NewEvaluator

func NewEvaluator(id string, signature *domain.Signature, session *tf.Session) *Evaluator

NewEvaluator creates new evaluator

func (*Evaluator) Close

func (e *Evaluator) Close() error

Close closes evaluator

func (*Evaluator) Evaluate

func (e *Evaluator) Evaluate(params []interface{}) ([]interface{}, error)

Evaluate evaluates model

type Runner

type Runner interface {
	Evaluate(context.Context, []interface{}) ([]interface{}, error)
}

type Service

type Service struct {

	// Should point to service.Service.ReloadOK
	ReloadOK *int32
	// contains filtered or unexported fields
}

Service is responsible for being the entrypoint for all Tensorflow model runs. It manages loading and reloading the model files, as well as providing metadata based off the model and configuration.

func NewService

func NewService(cfg *config.Model, fs afs.Service, metrics *gmetric.Service, sema *semaphore.Weighted,
	maxEvaluatorWait time.Duration) *Service

NewService creates an unprepared Service. This service isn't ready until ReloadIfNeeded() is called.

func (*Service) Close

func (s *Service) Close() error

func (*Service) Dictionary

func (s *Service) Dictionary() *common.Dictionary

func (*Service) Inputs

func (s *Service) Inputs() map[string]*domain.Input

func (*Service) Predict

func (s *Service) Predict(ctx context.Context, params []interface{}) ([]interface{}, error)

func (*Service) ReloadIfNeeded

func (s *Service) ReloadIfNeeded(ctx context.Context) error

Assumes that after the initial reload, there is no significant changes to the inputs and outputs from reloading the model. If a model reload results in changes to inputs or outputs, the resulting behavior is undefined. TODO restructure to easily test configuration signature merging.

func (*Service) Signature

func (s *Service) Signature() *domain.Signature

func (*Service) Stats

func (s *Service) Stats(r map[string]interface{})