README
¶
OONI Probe Measurement Engine
This directory contains private Go packages. Collectively these package are the measurement engine that empowers OONI Probe. Most of the code in this package derives from the ooni/probe-engine discontinued repository.
Reading documentation from the command line
You can read the Go documentation of a package by using go doc -all.
For example:
go doc -all ./internal/netxlite
Reading documentation in the browser
You can install the pkgsite tool using this command:
go install golang.org/x/pkgsite@latest
To run pkgsite, use:
pkgsite
Then visit http://127.0.0.1:8080/github.com/ooni/probe-cli/v3 with your browser to browse the documentation.
Getting information about a package
Use the go list -json subcommand. For example:
go list -json ./internal/netxlite
Generating a dependency graph
You can get a graph of the dependencies using kisielk/godepgraph.
For example:
godepgraph -s -novendor -p golang.org,gitlab.com ./internal/engine | dot -Tpng -o deps.png
You can further tweak which packages to exclude by appending
prefixes to the list passed to the -p flag.
Tutorials
The tutorial package contains tutorials on writing new experiments, using measurements libraries, and networking code.
Directories
¶
| Path | Synopsis |
|---|---|
|
Package bytecounter contains code to track the number of bytes sent and received by a probe.
|
Package bytecounter contains code to track the number of bytes sent and received by a probe. |
|
Package checkincache contains an on-disk cache for check-in responses.
|
Package checkincache contains an on-disk cache for check-in responses. |
|
cmd
|
|
|
apitool
Command apitool is a simple tool to fetch individual OONI measurements.
|
Command apitool is a simple tool to fetch individual OONI measurements. |
|
buildtool/internal/buildtoolmodel
Package buildtoolmodel contains the model for buildtool.
|
Package buildtoolmodel contains the model for buildtool. |
|
buildtool/internal/buildtooltest
Package buildtooltest contains code for testing buildtool.
|
Package buildtooltest contains code for testing buildtool. |
|
gardener
Command gardener helps with test-lists management.
|
Command gardener helps with test-lists management. |
|
gardener/internal/aggregationapi
Package aggregationapi allows one to query the OONI aggregation API.
|
Package aggregationapi allows one to query the OONI aggregation API. |
|
gardener/internal/dnsfix
Package dnsfix implements the dnsfix command.
|
Package dnsfix implements the dnsfix command. |
|
gardener/internal/dnsreport
Package dnsreport implements the dnsreport subcommand.
|
Package dnsreport implements the dnsreport subcommand. |
|
gardener/internal/sync
Package sync implements the sync subcommand.
|
Package sync implements the sync subcommand. |
|
gardener/internal/testlists
Package testlists contains code to read/rewrite the test lists.
|
Package testlists contains code to read/rewrite the test lists. |
|
getresources
Command getresources downloads the resources
|
Command getresources downloads the resources |
|
ghgen
Command ghgen regenerates selected GitHub actions.
|
Command ghgen regenerates selected GitHub actions. |
|
jafar
Jafar is a censorship simulation tool used for testing OONI.
|
Jafar is a censorship simulation tool used for testing OONI. |
|
jafar/badproxy
Package badproxy implements misbehaving proxies.
|
Package badproxy implements misbehaving proxies. |
|
jafar/flagx
Package flagx contains extensions for the standard library flag package.
|
Package flagx contains extensions for the standard library flag package. |
|
jafar/httpproxy
Package httpproxy contains a censoring HTTP proxy.
|
Package httpproxy contains a censoring HTTP proxy. |
|
jafar/iptables
Package iptables contains code for managing firewall rules.
|
Package iptables contains code for managing firewall rules. |
|
jafar/resolver
Package resolver contains a censoring DNS resolver.
|
Package resolver contains a censoring DNS resolver. |
|
jafar/tlsproxy
Package tlsproxy contains a censoring TLS proxy.
|
Package tlsproxy contains a censoring TLS proxy. |
|
jafar/uncensored
Package uncensored contains code used by Jafar to evade its own censorship efforts by taking alternate routes.
|
Package uncensored contains code used by Jafar to evade its own censorship efforts by taking alternate routes. |
|
miniooni
Command miniooni is a simple binary for research and QA purposes with a CLI interface similar to MK and OONI Probe v2.x.
|
Command miniooni is a simple binary for research and QA purposes with a CLI interface similar to MK and OONI Probe v2.x. |
|
oohelper
Command oohelper contains a simple command line client for the Web Connectivity test helper.
|
Command oohelper contains a simple command line client for the Web Connectivity test helper. |
|
oohelperd
Command oohelperd implements the Web Connectivity test helper.
|
Command oohelperd implements the Web Connectivity test helper. |
|
oonireport
Command oonireport uploads reports stored on disk to the OONI collector.
|
Command oonireport uploads reports stored on disk to the OONI collector. |
|
ooporthelper
command ooporthelper implements the Port Filtering test helper
|
command ooporthelper implements the Port Filtering test helper |
|
printversion
Command printversion prints the current version of this repository.
|
Command printversion prints the current version of this repository. |
|
Package dslx implements a domain specific language for writing network experiments.
|
Package dslx implements a domain specific language for writing network experiments. |
|
Package engine contains the engine API.
|
Package engine contains the engine API. |
|
experiment
|
|
|
dash
Package dash implements the DASH network experiment.
|
Package dash implements the DASH network experiment. |
|
dnscheck
Package dnscheck contains the DNS check experiment.
|
Package dnscheck contains the DNS check experiment. |
|
dnsping
Package dnsping is the experimental dnsping experiment.
|
Package dnsping is the experimental dnsping experiment. |
|
echcheck
Package echcheck contains the ECH blocking network experiment.
|
Package echcheck contains the ECH blocking network experiment. |
|
example
Package example contains a simple example experiment.
|
Package example contains a simple example experiment. |
|
fbmessenger
Package fbmessenger contains the Facebook Messenger network experiment.
|
Package fbmessenger contains the Facebook Messenger network experiment. |
|
hhfm
Package hhfm contains the HTTP Header Field Manipulation network experiment.
|
Package hhfm contains the HTTP Header Field Manipulation network experiment. |
|
hirl
Package hirl contains the HTTP Invalid Request Line network experiment.
|
Package hirl contains the HTTP Invalid Request Line network experiment. |
|
httphostheader
Package httphostheader contains the HTTP host header network experiment.
|
Package httphostheader contains the HTTP host header network experiment. |
|
ndt7
Package ndt7 contains the ndt7 network experiment.
|
Package ndt7 contains the ndt7 network experiment. |
|
portfiltering
Package portfiltering implements the portfiltering experiment
|
Package portfiltering implements the portfiltering experiment |
|
psiphon
Package psiphon implements the psiphon network experiment.
|
Package psiphon implements the psiphon network experiment. |
|
quicping
Package quicping implements the quicping network experiment.
|
Package quicping implements the quicping network experiment. |
|
riseupvpn
Package riseupvpn contains the RiseupVPN network experiment.
|
Package riseupvpn contains the RiseupVPN network experiment. |
|
run
Package run contains code to run other experiments.
|
Package run contains code to run other experiments. |
|
signal
Package signal contains the Signal network experiment.
|
Package signal contains the Signal network experiment. |
|
simplequicping
Package simplequicping is the experimental simplequicping experiment.
|
Package simplequicping is the experimental simplequicping experiment. |
|
sniblocking
Package sniblocking contains the SNI blocking network experiment.
|
Package sniblocking contains the SNI blocking network experiment. |
|
stunreachability
Package stunreachability contains the STUN reachability experiment.
|
Package stunreachability contains the STUN reachability experiment. |
|
tcpping
Package tcpping is the experimental tcpping experiment.
|
Package tcpping is the experimental tcpping experiment. |
|
telegram
Package telegram contains the Telegram network experiment.
|
Package telegram contains the Telegram network experiment. |
|
tlsmiddlebox
Package tlsmiddlebox implements the tlsmiddlebox experiment
|
Package tlsmiddlebox implements the tlsmiddlebox experiment |
|
tlsping
Package tlsping is the experimental tlsping experiment.
|
Package tlsping is the experimental tlsping experiment. |
|
tlstool
Package tlstool contains a TLS tool that we are currently using for running quick and dirty experiments.
|
Package tlstool contains a TLS tool that we are currently using for running quick and dirty experiments. |
|
tlstool/internal
Package internal contains the implementation of tlstool.
|
Package internal contains the implementation of tlstool. |
|
tor
Package tor contains the tor experiment.
|
Package tor contains the tor experiment. |
|
torsf
Package torsf contains the torsf experiment.
|
Package torsf contains the torsf experiment. |
|
urlgetter
Package urlgetter implements a nettest that fetches a URL.
|
Package urlgetter implements a nettest that fetches a URL. |
|
vanillator
Package vanillator contains the vanilla_tor experiment.
|
Package vanillator contains the vanilla_tor experiment. |
|
webconnectivity
Package webconnectivity implements OONI's Web Connectivity experiment.
|
Package webconnectivity implements OONI's Web Connectivity experiment. |
|
webconnectivity/internal
Package internal contains internal code.
|
Package internal contains internal code. |
|
webconnectivitylte
Package webconnectivitylte implements the web_connectivity experiment.
|
Package webconnectivitylte implements the web_connectivity experiment. |
|
whatsapp
Package whatsapp contains the WhatsApp network experiment.
|
Package whatsapp contains the WhatsApp network experiment. |
|
Package fsx contains io/fs extensions.
|
Package fsx contains io/fs extensions. |
|
Package geoipx contains code to use the embedded MaxMind-like databases.
|
Package geoipx contains code to use the embedded MaxMind-like databases. |
|
Package geolocate implements IP lookup, resolver lookup, and geolocation.
|
Package geolocate implements IP lookup, resolver lookup, and geolocation. |
|
Package httpapi contains code for calling HTTP APIs.
|
Package httpapi contains code for calling HTTP APIs. |
|
Package httpx contains http extensions.
|
Package httpx contains http extensions. |
|
Package humanize is like dustin/go-humanize.
|
Package humanize is like dustin/go-humanize. |
|
Package inputparser contains code to parse experiments input.
|
Package inputparser contains code to parse experiments input. |
|
Package kvstore implements model.KeyValueStore.
|
Package kvstore implements model.KeyValueStore. |
|
legacy
|
|
|
assetsdir
Package assetsdir contains code to cleanup the assets dir.
|
Package assetsdir contains code to cleanup the assets dir. |
|
mockable
Package mockable contains mockable objects
|
Package mockable contains mockable objects |
|
netx
Package netx contains code to perform network measurements.
|
Package netx contains code to perform network measurements. |
|
Package logx contains logging extensions
|
Package logx contains logging extensions |
|
Package measurex contains measurement extensions.
|
Package measurex contains measurement extensions. |
|
Package measurexlite contains measurement extensions.
|
Package measurexlite contains measurement extensions. |
|
Package mlablocatev2 implements m-lab locate services API v2.
|
Package mlablocatev2 implements m-lab locate services API v2. |
|
Package mocks contains mocks for implementing unit tests.
|
Package mocks contains mocks for implementing unit tests. |
|
Package model contains the shared interfaces and data structures.
|
Package model contains the shared interfaces and data structures. |
|
Package multierror contains code to manage multiple errors.
|
Package multierror contains code to manage multiple errors. |
|
Package must contains functions that panic on error.
|
Package must contains functions that panic on error. |
|
Package netemx contains ooni/netem adapters.
|
Package netemx contains ooni/netem adapters. |
|
Package netxlite contains network extensions.
|
Package netxlite contains network extensions. |
|
filtering
Package filtering allows to implement self-censorship.
|
Package filtering allows to implement self-censorship. |
|
quictesting
Package quictesting contains code useful to test QUIC.
|
Package quictesting contains code useful to test QUIC. |
|
Package ooapi describes how the OONI API works.
|
Package ooapi describes how the OONI API works. |
|
Package oonirun contains code to run OONI experiments.
|
Package oonirun contains code to run OONI experiments. |
|
Package optional contains safer code to handle optional values.
|
Package optional contains safer code to handle optional values. |
|
Package platform allows you to obtain the platform name.
|
Package platform allows you to obtain the platform name. |
|
Package probeservices contains code to contact OONI probe services.
|
Package probeservices contains code to contact OONI probe services. |
|
Package ptx contains code to use pluggable transports.
|
Package ptx contains code to use pluggable transports. |
|
Package randx contains math/rand extensions.
|
Package randx contains math/rand extensions. |
|
Package registry contains a registry of all the available experiments.
|
Package registry contains a registry of all the available experiments. |
|
Package runtimex contains runtime extensions.
|
Package runtimex contains runtime extensions. |
|
Package sessionresolver contains the resolver used by the session.
|
Package sessionresolver contains the resolver used by the session. |
|
Package shellx helps to write shell-like Go code.
|
Package shellx helps to write shell-like Go code. |
|
shellxtesting
Package shellxtesting supports shellx testing.
|
Package shellxtesting supports shellx testing. |
|
Package stuninput contains stun targets as well as code to format such targets according to various conventions.
|
Package stuninput contains stun targets as well as code to format such targets according to various conventions. |
|
Package testingx contains code useful for testing.
|
Package testingx contains code useful for testing. |
|
Package torlogs contains code to read tor logs.
|
Package torlogs contains code to read tor logs. |
|
Package tracex performs measurements using tracing.
|
Package tracex performs measurements using tracing. |
|
Package tunnel allows to create tunnels to speak with OONI backends and other services.
|
Package tunnel allows to create tunnels to speak with OONI backends and other services. |
|
mocks
Package mocks contains mocks for tunnel.
|
Package mocks contains mocks for tunnel. |
|
tutorial
|
|
|
dslx/chapter02
## Getting started
|
## Getting started |
|
experiment/torsf/chapter01
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
experiment/torsf/chapter02
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
generator
Command generator generates or re-generates the tutorial chapters.
|
Command generator generates or re-generates the tutorial chapters. |
|
measurex/chapter01
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter02
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter03
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter04
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter05
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter06
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter07
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter08
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter09
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter10
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter11
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter12
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter13
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
measurex/chapter14
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter01
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter02
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter03
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter04
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter05
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter06
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter07
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
netxlite/chapter08
-=-=- StartHere -=-=-
|
-=-=- StartHere -=-=- |
|
Package version contains version information.
|
Package version contains version information. |
Click to show internal directories.
Click to hide internal directories.