e2eutil

package
v0.0.0-...-ae3a0a2 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Dec 14, 2022 License: MPL-2.0 Imports: 30 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

View Source 
var EvalTemplate = template.Must(template.New("dump_eval").Parse(
	`{{.Index}}/{{.Total}} Job {{.Eval.JobID}} Eval {{.Eval.ID}}
  Type:         {{.Eval.Type}}
  TriggeredBy:  {{.Eval.TriggeredBy}}
  {{- if .Eval.DeploymentID}}
  Deployment:   {{.Eval.DeploymentID}}
  {{- end}}
  Status:       {{.Eval.Status}} {{if .Eval.StatusDescription}}({{.Eval.StatusDescription}}){{end}}
  {{- if .Eval.Wait}}
  Wait:         {{.Eval.Wait}} <- DEPRECATED
  {{- end}}
  {{- if not .Eval.WaitUntil.IsZero}}
  WaitUntil:    {{.Eval.WaitUntil}}
  {{- end}}
  {{- if .Eval.NextEval}}
  NextEval:     {{.Eval.NextEval}}
  {{- end}}
  {{- if .Eval.PreviousEval}}
  PrevEval:     {{.Eval.PreviousEval}}
  {{- end}}
  {{- if .Eval.BlockedEval}}
  BlockedEval:  {{.Eval.BlockedEval}}
  {{- end}}
  {{- if .Eval.FailedTGAllocs }}
  Failed Allocs:
  {{- end}}
  {{- range $k, $v := .Eval.FailedTGAllocs}}
    Failed Group: {{$k}}
      NodesEvaluated: {{$v.NodesEvaluated}}
      NodesFiltered:  {{$v.NodesFiltered}}
      NodesAvailable: {{range $dc, $n := $v.NodesAvailable}}{{$dc}}:{{$n}} {{end}}
      NodesExhausted: {{$v.NodesExhausted}}
      ClassFiltered:  {{len $v.ClassFiltered}}
      ConstraintFilt: {{len $v.ConstraintFiltered}}
      DimensionExhst: {{range $d, $n := $v.DimensionExhausted}}{{$d}}:{{$n}} {{end}}
      ResourcesExhst: {{range $r, $n := $v.ResourcesExhausted}}{{$r}}:{{$n}} {{end}}
      QuotaExhausted: {{range $i, $q := $v.QuotaExhausted}}{{$q}} {{end}}
      CoalescedFail:  {{$v.CoalescedFailures}}
      ScoreMetaData:  {{len $v.ScoreMetaData}}
      AllocationTime: {{$v.AllocationTime}}
  {{- end}}
  {{- if .Eval.QueuedAllocations}}
  QueuedAllocs: {{range $k, $n := .Eval.QueuedAllocations}}{{$k}}:{{$n}} {{end}}
  {{- end}}
  SnapshotIdx:  {{.Eval.SnapshotIndex}}
  CreateIndex:  {{.Eval.CreateIndex}}
  ModifyIndex:  {{.Eval.ModifyIndex}}
`))

Functions

func AgentDisconnect 

func AgentDisconnect(nodeID string, after time.Duration) (string, error)

AgentDisconnect is a test helper function that runs a raw_exec job that will disconnect a client at the network level and reconnect it after the specified period of time.

Returns once the job is registered with the job ID of the restart job and any registration errors, not after the duration, so that callers can take actions while the client is down.

func AgentRestart 

func AgentRestart(client *api.Client, nodeID string) (string, error)

AgentRestart is a test helper function that restarts a client node running under systemd using a raw_exec job. Returns the job ID of the restart job so that callers can clean it up.

func AgentRestartAfter 

func AgentRestartAfter(nodeID string, after time.Duration) (string, error)

AgentRestartAfter is a test helper function that runs a raw_exec job that will stop a client and restart it after the specified period of time. The node must be running under systemd.

Returns once the job is registered with the job ID of the restart job and any registration errors, not after the duration, so that callers can take actions while the client is down.

func AllocChecks 

func AllocChecks(allocID string) (string, error)

AllocChecks returns the CLI output from 'nomad alloc checks' on the given alloc ID.

func AllocExec 

func AllocExec(allocID, taskID, execCmd, ns string, wc *WaitConfig) (string, error)

AllocExec is a convenience wrapper that runs 'nomad alloc exec' with the passed execCmd via '/bin/sh -c', retrying if the task isn't ready

func AllocIDsFromAllocationListStubs 

func AllocIDsFromAllocationListStubs(allocs []*api.AllocationListStub) []string

func AllocLogs 

func AllocLogs(allocID string, logStream LogStream) (string, error)

func AllocStatuses 

func AllocStatuses(jobID, ns string) ([]string, error)

AllocStatuses returns a slice of client statuses

func AllocStatusesRescheduled 

func AllocStatusesRescheduled(jobID, ns string) ([]string, error)

AllocStatusesRescheduled is a helper function that pulls out client statuses only from rescheduled allocs.

func AllocTaskEventsForJob 

func AllocTaskEventsForJob(jobID, ns string) (map[string][]map[string]string, error)

AllocTaskEventsForJob returns a map of allocation IDs containing a map of Task Event key value pairs

func AllocTaskLogs 

func AllocTaskLogs(allocID, task string, logStream LogStream) (string, error)

func AllocsForJob 

func AllocsForJob(jobID, ns string) ([]map[string]string, error)

AllocsForJob returns a slice of key->value maps, each describing the values of the 'nomad job status' Allocations section (not actual structs.Allocation objects, query the API if you want those)

func AllocsForNode 

func AllocsForNode(nodeID string) ([]map[string]string, error)

AllocsForNode returns a slice of key->value maps, each describing the values of the 'nomad node status' Allocations section (not actual structs.Allocation objects, query the API if you want those)

func ChildrenJobSummary 

func ChildrenJobSummary(jobID string) ([]map[string]string, error)

func CleanupJobsAndGC 

func CleanupJobsAndGC(t *testing.T, jobIDs *[]string) func()

CleanupJobsAndGC stops and purges the list of jobIDs and runs a system gc. Returns a func so that the return value can be used in t.Cleanup

func CleanupJobsAndGCWithContext 

func CleanupJobsAndGCWithContext(t *testing.T, ctx context.Context, jobIDs *[]string)

CleanupJobsAndGCWithContext stops and purges the list of jobIDs and runs a system gc. The passed context allows callers to cancel the execution of the cleanup as they desire. This is useful for tests which attempt to remove the job as part of their run, but may fail before that point is reached.

func Command 

func Command(cmd string, args ...string) (string, error)

Command sends a command line argument to Nomad and returns the unbuffered stdout as a string (or, if there's an error, the stderr)

func ConsulClient 

func ConsulClient(t *testing.T) *capi.Client

ConsulClient creates a default Consul client based on the env vars from the test environment. Fails the test if it can't be created

func CreateConsulNamespaces 

func CreateConsulNamespaces(t *testing.T, client *capi.Client, namespaces []string)

CreateConsulNamespaces will create each namespace in Consul, with a description containing the namespace name.

Requires Consul Enterprise.

func CreateConsulPolicy 

func CreateConsulPolicy(t *testing.T, client *capi.Client, namespace string, policy ConsulPolicy) string

CreateConsulPolicy is used to create a Consul ACL policy backed by the given ConsulPolicy in the specified namespace.

Requires Consul Enterprise.

func CreateConsulToken 

func CreateConsulToken(t *testing.T, client *capi.Client, namespace, policyID string) string

CreateConsulToken is used to create a Consul ACL token backed by the policy of the given policyID in the specified namespace.

Requires Consul Enterprise.

func DeleteConsulConfigEntry 

func DeleteConsulConfigEntry(t *testing.T, client *capi.Client, namespace, kind, name string)

DeleteConsulConfigEntry deletes the ConfigEntry of the given namespace, kind, and name.

Requires Consul Enterprise.

func DeleteConsulKey 

func DeleteConsulKey(t *testing.T, client *capi.Client, namespace, key string)

DeleteConsulKey deletes the key from the Consul KV store from given namespace.

Requires Consul Enterprise.

func DeleteConsulNamespaces 

func DeleteConsulNamespaces(t *testing.T, client *capi.Client, namespaces []string)

DeleteConsulNamespaces will delete each namespace from Consul.

Requires Consul Enterprise.

func DeleteConsulPolicies 

func DeleteConsulPolicies(t *testing.T, client *capi.Client, policies map[string][]string)

DeleteConsulPolicies is used to delete a set Consul ACL policies from Consul.

Requires Consul Enterprise.

func DeleteConsulTokens 

func DeleteConsulTokens(t *testing.T, client *capi.Client, tokens map[string][]string)

DeleteConsulTokens is used to delete a set of tokens from Consul.

Requires Consul Enterprise.

func DeploymentsForJob 

func DeploymentsForJob(t *testing.T, nomadClient *api.Client, jobID string) []*api.Deployment

func Dispatch 

func Dispatch(jobID string, meta map[string]string, payload string) error

Dispatch dispatches a parameterized job

func DispatchedJobs 

func DispatchedJobs(jobID string) ([]map[string]string, error)

func DumpEvals 

func DumpEvals(c *api.Client, jobID string) string

DumpEvals for a job. This is intended to be used during test development or prior to exiting a test after an assertion failed.

func GetField 

func GetField(output, key string) (string, error)

GetField returns the value of an output field (ex. the "Submit Date" field of `nomad job status :id`)

func GetSection 

func GetSection(output, key string) (string, error)

GetSection returns a section, with its field header but without its title. (ex. the Allocations section of `nomad job status :id`)

func JobInspectTemplate 

func JobInspectTemplate(jobID, template string) (string, error)

JobInspectTemplate runs nomad job inspect and formats the output using the specified go template

func LastDeploymentID 

func LastDeploymentID(jobID, ns string) (string, error)

func ListConsulNamespaces 

func ListConsulNamespaces(t *testing.T, client *capi.Client) []string

ListConsulNamespaces will list the namespaces in Consul.

Requires Consul Enterprise.

func ListLinuxClientNodes 

func ListLinuxClientNodes(client *api.Client) ([]string, error)

ListLinuxClientNodes returns a list of Linux client IDs, so that tests can skip operating-specific tests if there are no Linux clients available Returns an error only on client errors.

func ListWindowsClientNodes 

func ListWindowsClientNodes(client *api.Client) ([]string, error)

ListWindowsClientNodes returns a list of Windows client IDs, so that tests can skip operating-specific tests if there are no Windows clients available. Returns an error only on client errors.

func NewE2EJob 

func NewE2EJob(jobfile string) framework.TestCase

func NodeStatusList 

func NodeStatusList() ([]map[string]string, error)

func NodeStatusListFiltered 

func NodeStatusListFiltered(filterFn func(string) bool) ([]map[string]string, error)

func NomadClient 

func NomadClient(t *testing.T) *napi.Client

NomadClient creates a default Nomad client based on the env vars from the test environment. Fails the test if it can't be created

func Parse2 

func Parse2(t *testing.T, jobFile string) (*api.Job, error)

func ParseColumns 

func ParseColumns(section string) ([]map[string]string, error)

ParseColumns maps the CLI output for a columized section (without title) to a slice of key->value pairs for each row in that section. (ex. the Allocations section of `nomad job status :id`)

func ParseFields 

func ParseFields(section string) (map[string]string, error)

ParseFields maps the CLI output for a key-value section (without title) to map of the key->value pairs in that section (ex. the Latest Deployment section of `nomad job status :id`)

func PeriodicForce 

func PeriodicForce(jobID string) error

PeriodicForce forces a periodic job to dispatch

func PreviouslyLaunched 

func PreviouslyLaunched(jobID string) ([]map[string]string, error)

func PutConsulKey 

func PutConsulKey(t *testing.T, client *capi.Client, namespace, key, value string)

PutConsulKey sets key:value in the Consul KV store under given namespace.

Requires Consul Enterprise.

func ReadConsulConfigEntry 

func ReadConsulConfigEntry(t *testing.T, client *capi.Client, namespace, kind, name string) capi.ConfigEntry

ReadConsulConfigEntry retrieves the ConfigEntry of the given namespace, kind, and name.

Requires Consul Enterprise.

func Register 

func Register(jobID, jobFilePath string) error

Register registers a jobspec from a file but with a unique ID. The caller is responsible for recording that ID for later cleanup.

func RegisterAllocs 

func RegisterAllocs(t *testing.T, nomadClient *api.Client, jobFile, jobID, cToken string) []*api.AllocationListStub

func RegisterAndWaitForAllocs 

func RegisterAndWaitForAllocs(t *testing.T, nomadClient *api.Client, jobFile, jobID, cToken string) []*api.AllocationListStub

RegisterAndWaitForAllocs wraps RegisterAllocs but blocks until Evals successfully create Allocs.

func RegisterFromJobspec 

func RegisterFromJobspec(jobID, jobspec string) error

RegisterFromJobspec registers a jobspec from a string, also with a unique ID. The caller is responsible for recording that ID for later cleanup.

func RegisterWithArgs 

func RegisterWithArgs(jobID, jobFilePath string, args ...string) error

RegisterWithArgs registers a jobspec from a file but with a unique ID. The optional args are added to the run command. The caller is responsible for recording that ID for later cleanup.

func RequireConsulDeregistered 

func RequireConsulDeregistered(require *require.Assertions, client *capi.Client, namespace, service string)

RequireConsulDeregistered asserts that the service eventually is de-registered from Consul.

func RequireConsulRegistered 

func RequireConsulRegistered(require *require.Assertions, client *capi.Client, namespace, service string, count int)

RequireConsulRegistered assert that the service is registered in Consul.

func RequireConsulStatus 

func RequireConsulStatus(require *require.Assertions, client *capi.Client, namespace, service, expectedStatus string)

RequireConsulStatus asserts the aggregate health of the service converges to the expected status.

func StopJob 

func StopJob(jobID string, args ...string) error

func VaultClient 

func VaultClient(t *testing.T) *vapi.Client

VaultClient creates a default Vault client based on the env vars from the test environment. Fails the test if it can't be created

func WaitForAllocFile 

func WaitForAllocFile(allocID, path string, test func(string) bool, wc *WaitConfig) error

WaitForAllocFile is a helper that grabs a file via alloc fs and tests its contents; useful for checking the results of rendered templates

func WaitForAllocNotPending 

func WaitForAllocNotPending(t *testing.T, nomadClient *api.Client, allocID string)

func WaitForAllocRunning 

func WaitForAllocRunning(t *testing.T, nomadClient *api.Client, allocID string)

func WaitForAllocStatus 

func WaitForAllocStatus(t *testing.T, nomadClient *api.Client, allocID string, status string)

func WaitForAllocStatusComparison 

func WaitForAllocStatusComparison(query func() ([]string, error), comparison func([]string) bool, wc *WaitConfig) error

WaitForAllocStatusComparison is a convenience wrapper that polls the query function until the comparison function returns true.

func WaitForAllocStatusExpected 

func WaitForAllocStatusExpected(jobID, ns string, expected []string) error

WaitForAllocStatusExpected polls 'nomad job status' and exactly compares the status of all allocations (including any previous versions) against the expected list.

func WaitForAllocStopped 

func WaitForAllocStopped(t *testing.T, nomadClient *api.Client, allocID string)

func WaitForAllocTaskComplete 

func WaitForAllocTaskComplete(t *testing.T, nomadClient *api.Client, allocID, task string)

func WaitForAllocTaskRunning 

func WaitForAllocTaskRunning(t *testing.T, nomadClient *api.Client, allocID, task string)

func WaitForAllocTaskState 

func WaitForAllocTaskState(t *testing.T, nomadClient *api.Client, allocID, task, state string)

func WaitForAllocsNotPending 

func WaitForAllocsNotPending(t *testing.T, nomadClient *api.Client, allocIDs []string)

func WaitForAllocsRunning 

func WaitForAllocsRunning(t *testing.T, nomadClient *api.Client, allocIDs []string)

func WaitForAllocsStatus 

func WaitForAllocsStatus(t *testing.T, nomadClient *api.Client, allocIDs []string, status string)

func WaitForAllocsStopped 

func WaitForAllocsStopped(t *testing.T, nomadClient *api.Client, allocIDs []string)

func WaitForDeployment 

func WaitForDeployment(t *testing.T, nomadClient *api.Client, deployID string, status string, statusDesc string)

func WaitForJobStopped 

func WaitForJobStopped(t *testing.T, nomadClient *api.Client, job string)

WaitForJobStopped stops a job and waits for all of its allocs to terminate.

func WaitForLastDeploymentStatus 

func WaitForLastDeploymentStatus(jobID, ns, status string, wc *WaitConfig) error

func WaitForLeader 

func WaitForLeader(t *testing.T, nomadClient *api.Client)

func WaitForNodeStatus 

func WaitForNodeStatus(nodeID, status string, wc *WaitConfig) error

func WaitForNodesReady 

func WaitForNodesReady(t *testing.T, nomadClient *api.Client, nodes int)

WaitForNodesReady waits until at least `nodes` number of nodes are ready or fails the test.

Types

type AllocsByName 

type AllocsByName []*api.AllocationListStub

AllocsByName sorts allocs by Name

func (AllocsByName) Len 

func (a AllocsByName) Len() int

func (AllocsByName) Less 

func (a AllocsByName) Less(i, j int) bool

func (AllocsByName) Swap 

func (a AllocsByName) Swap(i, j int)

type ConsulPolicy 

type ConsulPolicy struct {
	Name  string // e.g. nomad-operator
	Rules string // e.g. service "" { policy="write" }
}

ConsulPolicy is used for create Consul ACL policies that Consul ACL tokens can make use of.

type LogStream 

type LogStream int
const (
	LogsStdErr LogStream = iota
	LogsStdOut
)

type WaitConfig 

type WaitConfig struct {
	Interval time.Duration
	Retries  int64
}

WaitConfig is an interval and wait time that can be passed to a waiter function, but with a default value that comes from the OrDefault method if the config is nil

func (*WaitConfig) OrDefault 

func (wc *WaitConfig) OrDefault() (time.Duration, int64)

OrDefault returns a default wait config of 10s.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.