queue

Documentation

Index

• Constants
• type Breaker
  • func NewBreaker(queueDepth, maxConcurrency int32) *Breaker
  • func (b *Breaker) Maybe(thunk func()) bool
• type Channels
• type Poke
• type Stats
  • func NewStats(podName string, channels Channels) *Stats

Constants

const (
	// AutoscalerNamespace needs to match the service account, which needs to
	// be a single, known namespace. This ensures that projects created in
	// non-default namespaces continue to work with autoscaling.
	AutoscalerNamespace = "knative-serving-system"

	// RequestQueuePortName specifies the port name to use for http requests
	// in queue-proxy container.
	RequestQueuePortName string = "queue-port"

	// RequestQueuePort specifies the port number to use for http requests
	// in queue-proxy container.
	RequestQueuePort = 8012

	// RequestQueueAdminPortName specifies the port name for
	// health check and lifecyle hooks for queue-proxy.
	RequestQueueAdminPortName string = "queueadm-port"

	// RequestQueueAdminPort specifies the port number for
	// health check and lifecyle hooks for queue-proxy.
	RequestQueueAdminPort = 8022

	// RequestQueueQuitPath specifies the path to send quit request to
	// queue-proxy. This is used for preStop hook of queue-proxy. It:
	// - marks the service as not ready, so that requests will no longer
	//   be routed to it,
	// - adds a small delay, so that the container doesn't get killed at
	//   the same time the pod is marked for removal.
	RequestQueueQuitPath = "quitquitquit"

	// RequestQueueHealthPath specifies the path for health checks for
	// queue-proxy.
	RequestQueueHealthPath = "health"
)

Types

type Breaker

type Breaker struct {
	// contains filtered or unexported fields
}

Breaker is a component that enforces a concurrency limit on the execution of a function. It also maintains a queue of function executions in excess of the concurrency limit. Function call attempts beyond the limit of the queue are failed immediately.

func NewBreaker

func NewBreaker(queueDepth, maxConcurrency int32) *Breaker

NewBreaker creates a Breaker with the desired queue depth and concurrency limit.

func (*Breaker) Maybe

func (b *Breaker) Maybe(thunk func()) bool

Maybe conditionally executes thunk based on the Breaker concurrency and queue parameters. If the concurrency limit and queue capacity are already consumed, Maybe returns immediately without calling thunk. If the thunk was executed, Maybe returns true, else false.

type Channels

type Channels struct {
	// Ticks with every request arrived
	ReqInChan chan Poke
	// Ticks with every request completed
	ReqOutChan chan Poke
	// Ticks at every quantization interval
	QuantizationChan <-chan time.Time
	// Ticks with every stat report request
	ReportChan <-chan time.Time
	// Stat reporting channel
	StatChan chan *autoscaler.Stat
}

Channels is a structure for holding the channels for driving Stats. It's just to make the NewStats signature easier to read.

type Poke

type Poke struct{}

Poke is a token to push onto Stats Channels for recording requests stats.

type Stats

type Stats struct {
	// contains filtered or unexported fields
}

Stats is a structure for holding channels per pod.

func NewStats

func NewStats(podName string, channels Channels) *Stats

NewStats instantiates a new instance of Stats.