monitoring

Documentation

Index

• type MetricsMonitor
  • func NewMetricsMonitor(p *infprocessor.P) *MetricsMonitor
  • func (m *MetricsMonitor) ObserveCompletionLatency(modelID string, latency time.Duration)
  • func (m *MetricsMonitor) Run(ctx context.Context, interval time.Duration) error
  • func (m *MetricsMonitor) UnregisterAllCollectors()
  • func (m *MetricsMonitor) UpdateCompletionRequest(modelID string, c int)
• type MetricsMonitoring

Types

type MetricsMonitor

type MetricsMonitor struct {
	// contains filtered or unexported fields
}

MetricsMonitor holds and updates Prometheus metrics.

func NewMetricsMonitor

func NewMetricsMonitor(p *infprocessor.P) *MetricsMonitor

NewMetricsMonitor returns a new MetricsMonitor.

func (*MetricsMonitor) ObserveCompletionLatency

func (m *MetricsMonitor) ObserveCompletionLatency(modelID string, latency time.Duration)

ObserveCompletionLatency observes a new latency data for a completion request.

func (*MetricsMonitor) Run

func (m *MetricsMonitor) Run(ctx context.Context, interval time.Duration) error

Run updates the metrics periodically.

func (*MetricsMonitor) UnregisterAllCollectors

func (m *MetricsMonitor) UnregisterAllCollectors()

UnregisterAllCollectors unregisters all connectors.

func (*MetricsMonitor) UpdateCompletionRequest

func (m *MetricsMonitor) UpdateCompletionRequest(modelID string, c int)

UpdateCompletionRequest updates the number of completion requests.

type MetricsMonitoring

type MetricsMonitoring interface {
	ObserveCompletionLatency(modelID string, latency time.Duration)
	UpdateCompletionRequest(modelID string, c int)
}

MetricsMonitoring is an interface for monitoring metrics.