ch-compliance/

README

PromQL Compatibility testing

https://github.com/prometheus/compliance/tree/main/promql#promql-compliance-tester

To build and install:

go install github.com/go-faster/oteldb/cmd/promql-compliance-tester

To run with targets in docker-compose:

promql-compliance-tester -config-file promql-test-queries.yml -config-file test-oteldb.yml

NOTE: Results will be false-positive until enough data (~20min) is gathered.

This check was disabled as being broken on latest prometheus reference:

# label_replace fails when there would be duplicated identical output label sets.
# !!! HACK: This was disabled because current prometheus reference implementation does not fail !!!
- query: 'label_replace(demo_num_cpus, "instance", "", "", "")'
  should_fail: true

Was producing an error:

FATA[0000] Error running comparison: expected reference API query "label_replace(demo_num_cpus, \"instance\", \"\", \"\", \"\")" to fail, but succeeded  source="main.go:137

Latest result:

Total: 547 / 548 (99.82%) passed, 0 unsupported