Documentation
¶
Overview ¶
Package harness provides a reusable test framework akin to the standard "testing" Go package. For now there is no automated code generation component like the "go test" command but that may be a future extension. Test functions must be of type `func(*harness.H)` and registered directly with a test Suite struct which can then be launched via the Run method.
Within these functions, use the Error, Fail or related methods to signal failure.
Tests may be skipped if not applicable with a call to the Skip method of *H:
func NeedsSomeData(h *harness.H) {
if os.Getenv("SOME_DATA") == "" {
h.Skip("skipping test due to missing SOME_DATA")
}
...
}
Subtests ¶
The Run method of H allow defining subtests, without having to define separate functions for each. This enables uses like table-driven and hierarchical tests. It also provides a way to share common setup and tear-down code:
func Foo(h *harness.H) {
// <setup code>
h.Run("A=1", func(h *harness.H) { ... })
h.Run("A=2", func(h *harness.H) { ... })
h.Run("B=1", func(h *harness.H) { ... })
// <tear-down code>
}
Each subtest has a unique name: the combination of the name of the top-level test and the sequence of names passed to Run, separated by slashes, with an optional trailing sequence number for disambiguation.
The argument to the -harness.run command-line flag is an unanchored regular expression that matches the test's name. For tests with multiple slash-separated elements, such as subtests, the argument is itself slash-separated, with expressions matching each name element in turn. Because it is unanchored, an empty expression matches any string. For example, using "matching" to mean "whose name contains":
go run foo.go -harness.run '' # Run all tests. go run foo.go -harness.run Foo # Run top-level tests matching "Foo", such as "TestFooBar". go run foo.go -harness.run Foo/A= # For top-level tests matching "Foo", run subtests matching "A=". go run foo.go -harness.run /A=1 # For all top-level tests, run subtests matching "A=1".
Subtests can also be used to control parallelism. A parent test will only complete once all of its subtests complete. In this example, all tests are run in parallel with each other, and only with each other, regardless of other top-level tests that may be defined:
func GroupedParallel(h *harness.H) {
for _, tc := range tests {
tc := tc // capture range variable
h.Run(tc.Name, func(h *harness.H) {
h.Parallel()
...
})
}
}
Run does not return until parallel subtests have completed, providing a way to clean up after a group of parallel tests:
func TeardownParallel(h *harness.H) {
// This Run will not return until the parallel tests finish.
h.Run("group", func(h *harness.H) {
h.Run("Test1", parallelTest1)
h.Run("Test2", parallelTest2)
h.Run("Test3", parallelTest3)
})
// <tear-down code>
}
Suite ¶
Individual tests are grouped into a test suite in order to execute them. TODO: this part of the API deviates from the "testing" package and is TBD.
A simple implementation of a test suite:
func SomeTest(h *harness.H) {
h.Skip("TODO")
}
func main() {
suite := harness.NewSuite(Options{}, Tests{
"SomeTest": SomeTest,
})
if err := suite.Run(); err != nil {
fmt.Fprintln(os.Stderr, err)
fmt.Println("FAIL")
os.Exit(1)
}
fmt.Println("PASS")
}
Index ¶
- Variables
- func CleanOutputDir(path string) (string, error)
- type H
- func (c *H) Context() context.Context
- func (c *H) Error(args ...interface{})
- func (c *H) Errorf(format string, args ...interface{})
- func (c *H) Fail()
- func (c *H) FailNow()
- func (c *H) Failed() bool
- func (c *H) Fatal(args ...interface{})
- func (c *H) Fatalf(format string, args ...interface{})
- func (c *H) Log(args ...interface{})
- func (c *H) Logf(format string, args ...interface{})
- func (c *H) Name() string
- func (h *H) OutputDir() string
- func (t *H) Parallel()
- func (t *H) Run(name string, f func(t *H)) bool
- func (c *H) Skip(args ...interface{})
- func (c *H) SkipNow()
- func (c *H) Skipf(format string, args ...interface{})
- func (c *H) Skipped() bool
- func (h *H) TempDir(prefix string) string
- func (h *H) TempFile(prefix string) *os.File
- func (h *H) Verbose() bool
- type Options
- type Suite
- type Test
- type Tests
Constants ¶
This section is empty.
Variables ¶
var ( SuiteEmpty = errors.New("harness: no tests to run") SuiteFailed = errors.New("harness: test suite failed") )
Functions ¶
func CleanOutputDir ¶ added in v0.6.0
CleanOutputDir creates/empties an output directory and returns the cleaned path. If the path already exists it must be named similar to `_foo_temp` or contain `.harness_temp` to indicate removal is safe; we don't want users wrecking things by accident with `--output-dir /tmp`
Types ¶
type H ¶
type H struct {
// contains filtered or unexported fields
}
H is a type passed to Test functions to manage test state and support formatted test logs. Logs are accumulated during execution and dumped to standard output when done.
A test ends when its Test function returns or calls any of the methods FailNow, Fatal, Fatalf, SkipNow, Skip, or Skipf. Those methods, as well as the Parallel method, must be called only from the goroutine running the Test function.
The other reporting methods, such as the variations of Log and Error, may be called simultaneously from multiple goroutines.
func (*H) Context ¶
Context returns the context for the current test. The context is cancelled when the test finishes. A goroutine started during a test can wait for the context's Done channel to become readable as a signal that the test is over, so that the goroutine can exit.
func (*H) Error ¶
func (c *H) Error(args ...interface{})
Error is equivalent to Log followed by Fail.
func (*H) Fail ¶
func (c *H) Fail()
Fail marks the function as having failed but continues execution.
func (*H) FailNow ¶
func (c *H) FailNow()
FailNow marks the function as having failed and stops its execution. Execution will continue at the next test. FailNow must be called from the goroutine running the test function, not from other goroutines created during the test. Calling FailNow does not stop those other goroutines.
func (*H) Fatal ¶
func (c *H) Fatal(args ...interface{})
Fatal is equivalent to Log followed by FailNow.
func (*H) Log ¶
func (c *H) Log(args ...interface{})
Log formats its arguments using default formatting, analogous to Println, and records the text in the error log. The text will be printed only if the test fails or the -harness.v flag is set.
func (*H) Logf ¶
Logf formats its arguments according to the format, analogous to Printf, and records the text in the error log. A final newline is added if not provided. The text will be printed only if the test fails or the -harness.v flag is set.
func (*H) OutputDir ¶ added in v0.4.0
OutputDir returns the path to a directory for storing data used by the current test. Only test frameworks should care about this. Individual tests should normally use H.TempDir or H.TempFile
func (*H) Parallel ¶
func (t *H) Parallel()
Parallel signals that this test is to be run in parallel with (and only with) other parallel tests.
func (*H) Run ¶
Run runs f as a subtest of t called name. It reports whether f succeeded. Run will block until all its parallel subtests have completed.
func (*H) Skip ¶
func (c *H) Skip(args ...interface{})
Skip is equivalent to Log followed by SkipNow.
func (*H) SkipNow ¶
func (c *H) SkipNow()
SkipNow marks the test as having been skipped and stops its execution. If a test fails (see Error, Errorf, Fail) and is then skipped, it is still considered to have failed. Execution will continue at the next test. See also FailNow. SkipNow must be called from the goroutine running the test, not from other goroutines created during the test. Calling SkipNow does not stop those other goroutines.
func (*H) TempDir ¶ added in v0.4.0
TempDir creates a new directory under OutputDir. No cleanup is required.
type Options ¶
type Options struct {
// The temporary directory in which to write profile files, logs, etc.
OutputDir string
// Report as tests are run; default is silent for success.
Verbose bool
// Run only tests matching a regexp.
Match string
// Enable memory profiling.
MemProfile bool
MemProfileRate int
// Enable CPU profiling.
CpuProfile bool
// Enable goroutine block profiling.
BlockProfile bool
BlockProfileRate int
// Enable execution trace.
ExecutionTrace bool
// Panic Suite execution after a timeout (0 means unlimited).
Timeout time.Duration
// Limit number of tests to run in parallel (0 means GOMAXPROCS).
Parallel int
Reporters reporters.Reporters
}
Options
type Suite ¶
type Suite struct {
// contains filtered or unexported fields
}
Suite is a type passed to a TestMain function to run the actual tests. Suite manages the execution of a set of test functions.
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
This example program illustrates how to create a custom test suite based on the harness package.
|
This example program illustrates how to create a custom test suite based on the harness package. |