README
¶
The Go implementation of the libp2p Networking Stack.
Table of Contents
Background
libp2p is a networking stack and library modularized out of The IPFS Project, and bundled separately for other tools to use.
libp2p is the product of a long, and arduous quest of understanding -- a deep dive into the internet's network stack, and plentiful peer-to-peer protocols from the past. Building large-scale peer-to-peer systems has been complex and difficult in the last 15 years, and libp2p is a way to fix that. It is a "network stack" -- a protocol suite -- that cleanly separates concerns, and enables sophisticated applications to only use the protocols they absolutely need, without giving up interoperability and upgradeability. libp2p grew out of IPFS, but it is built so that lots of people can use it, for lots of different projects.
We will be writing a set of docs, posts, tutorials, and talks to explain what p2p is, why it is tremendously useful, and how it can help your existing and new projects. But in the meantime, check out
Usage
This repository (go-libp2p
) serves as the entrypoint to the universe of modules that compose the Go implementation of the libp2p stack. Libp2p requires go 1.12+.
We mainly use Go modules for our dependency and release management (and thus require go >= 1.12+). In order to get the best developer experience, we recommend you do too. Otherwise, you may ocassionally encounter a breaking build as you'll be running off master (which, by definition, is not guaranteed to be stable).
You can start using go-libp2p in your Go application simply by adding imports from our repos, e.g.:
import "github.com/libp2p/go-libp2p"
Run go get
or go build
, excluding the libp2p repos from Go modules proxy usage. You only need to do this the first time you import go-libp2p to make sure you latch onto the correct version lineage (see golang/go#34189 for context):
$ GOPRIVATE='github.com/libp2p/*' go get ./...
The Go build tools will look for available releases, and will pick the highest available one.
As new releases of go-libp2p are made available, you can upgrade your application by manually editing your go.mod
file, or using the Go tools to maintain module requirements.
API
Examples
Examples can be found in the examples repo.
Development
Using the go-libp2p Workspace
While developing, you may need to make changes to several modules at once, or you may want changes made locally in one module to be available for import by another.
The go-libp2p workspace provides a developer-oriented view of the modules that comprise go-libp2p.
Using the tooling in the workspace repository, you can checkout all of go-libp2p's module repos and enter "local mode", which adds replace directives to the go.mod files in each local working copy. When you build locally, the libp2p depdendencies will be resolved from your local working copies.
Once you've committed your changes, you can switch back to "remote mode", which removes the replace directives and pulls imports from the main go module cache.
See the workspace repo for more information.
About gx
Before adopting gomod, libp2p used gx to manage dependencies using IPFS.
Due to the difficulties in keeping both dependency management solutions up-to-date, gx support was ended in April 2019.
Ending gx support does not mean that existing gx builds will break. Because gx references dependencies by their immutable IPFS hash, any currently working gx builds will continue to work for as long as the dependencies are resolvable in IPFS.
However, new changes to go-libp2p will not be published via gx, and users are encouraged to adopt gomod to stay up-to-date.
If you experience any issues migrating from gx to gomod, please join the discussion at the libp2p forums.
Tests
go test ./...
will run all tests in the repo.
Packages
This table is generated using the module
package-table
withpackage-table --data=package-list.json
.
List of packages currently in existence for libp2p:
Name | CI/Travis | Coverage | Description |
---|---|---|---|
Libp2p | |||
go-libp2p |
go-libp2p entry point | ||
go-libp2p-core |
core interfaces, types, and abstractions | ||
go-libp2p-blankhost |
minimal implementation of the "host" interface | ||
Network | |||
go-libp2p-swarm |
reference implementation of network state machine | ||
Transport | |||
go-ws-transport |
WebSocket transport | ||
go-tcp-transport |
TCP transport | ||
go-libp2p-quic-transport |
QUIC transport | ||
go-udp-transport |
UDP transport | ||
go-utp-transport |
uTorrent transport (UTP) | ||
go-libp2p-circuit |
relay transport | ||
go-libp2p-transport-upgrader |
upgrades multiaddr-net connections into full libp2p transports | ||
go-libp2p-reuseport-transport |
partial transport for building transports that reuse ports | ||
Encrypted Channels | |||
go-libp2p-secio |
SecIO crypto channel | ||
go-libp2p-tls |
TLS 1.3+ crypto channel | ||
go-conn-security-multistream |
multistream multiplexed meta crypto channel | ||
Private Network | |||
go-libp2p-pnet |
reference private networking implementation | ||
Stream Muxers | |||
go-libp2p-yamux |
YAMUX stream multiplexer | ||
go-libp2p-mplex |
MPLEX stream multiplexer | ||
NAT Traversal | |||
go-libp2p-nat |
|||
Peerstore | |||
go-libp2p-peerstore |
reference implementation of peer metadata storage component | ||
Connection Manager | |||
go-libp2p-connmgr |
reference implementation of connection manager | ||
Routing | |||
go-libp2p-record |
record type and validator logic | ||
go-libp2p-kad-dht |
Kademlia-like router | ||
go-libp2p-kbucket |
Kademlia routing table helper types | ||
go-libp2p-coral-dht |
Router based on Coral DHT | ||
go-libp2p-pubsub-router |
record-store over pubsub adapter | ||
Consensus | |||
go-libp2p-consensus |
consensus protocols interfaces | ||
go-libp2p-raft |
consensus implementation over raft | ||
Pubsub | |||
go-libp2p-pubsub |
multiple pubsub over libp2p implementations | ||
RPC | |||
go-libp2p-gorpc |
a simple RPC library for libp2p | ||
Utilities/miscellaneous | |||
go-libp2p-loggables |
logging helpers | ||
go-maddr-filter |
multiaddr filtering helpers | ||
go-libp2p-netutil |
misc utilities | ||
go-msgio |
length prefixed data channel | ||
go-addr-util |
address utilities for libp2p swarm | ||
go-buffer-pool |
a variable size buffer pool for go | ||
go-libp2p-routing-helpers |
routing helpers | ||
go-reuseport |
enables reuse of addresses | ||
go-sockaddr |
utils for sockaddr conversions | ||
go-flow-metrics |
metrics library | ||
go-libp2p-gostream |
Go 'net' wrappers for libp2p | ||
go-libp2p-http |
HTTP on top of libp2p streams | ||
Testing and examples | |||
go-libp2p-testing |
a collection of testing utilities for libp2p | ||
go-libp2p-examples |
go-libp2p examples and tutorials |
Contribute
go-libp2p is part of The IPFS Project, and is MIT-licensed open source software. We welcome contributions big and small! Take a look at the community contributing notes. Please make sure to check the issues. Search the closed ones before reporting things, and help us with the open ones.
Guidelines:
- read the libp2p spec
- please make branches + pull-request, even if working on the main repository
- ask questions or talk about things in issues, our discussion forums, or #libp2p or #ipfs on freenode.
- ensure you are able to contribute (no legal issues please -- we use the DCO)
- run
go fmt
before pushing any code - run
golint
andgo vet
too -- some things (like protobuf files) are expected to fail. - get in touch with @raulk and @mgoelzer about how best to contribute
- have fun!
There's a few things you can do right now to help out:
- Go through the modules below and check out existing issues. This would be especially useful for modules in active development. Some knowledge of IPFS/libp2p may be required, as well as the infrasture behind it - for instance, you may need to read up on p2p and more complex operations like muxing to be able to help technically.
- Perform code reviews.
- Add tests. There can never be enough tests.
The last gx published version of this module was: 6.0.41: QmTRN7hRxvGkxKxDdeudty7sRet4L7ZKZCqKsXHa79wmAc
Documentation
¶
Index ¶
- Variables
- func New(ctx context.Context, opts ...Option) (host.Host, error)
- func NewWithoutDefaults(ctx context.Context, opts ...Option) (host.Host, error)
- type Config
- type Option
- func AddrsFactory(factory config.AddrsFactory) Option
- func AutoNATServiceRateLimit(global, perPeer int, interval time.Duration) Option
- func BandwidthReporter(rep metrics.Reporter) Option
- func ChainOptions(opts ...Option) Option
- func ConnectionGater(cg connmgr.ConnectionGater) Option
- func ConnectionManager(connman connmgr.ConnManager) Option
- func DefaultStaticRelays() Option
- func DisableRelay() Option
- func EnableAutoRelay() Option
- func EnableNATService() Option
- func EnableRelay(options ...circuit.RelayOpt) Option
- func FilterAddresses(addrs ...*net.IPNet) Optiondeprecated
- func Filters(filters *ma.Filters) Optiondeprecated
- func ForceReachabilityPrivate() Option
- func ForceReachabilityPublic() Option
- func Identity(sk crypto.PrivKey) Option
- func ListenAddrStrings(s ...string) Option
- func ListenAddrs(addrs ...ma.Multiaddr) Option
- func Muxer(name string, tpt interface{}) Option
- func NATManager(nm config.NATManagerC) Option
- func NATPortMap() Option
- func Peerstore(ps peerstore.Peerstore) Option
- func Ping(enable bool) Option
- func PrivateNetwork(psk pnet.PSK) Option
- func Routing(rt config.RoutingC) Option
- func Security(name string, tpt interface{}) Option
- func StaticRelays(relays []peer.AddrInfo) Option
- func Transport(tpt interface{}) Option
- func UserAgent(userAgent string) Option
Constants ¶
This section is empty.
Variables ¶
var DefaultEnableRelay = func(cfg *Config) error { return cfg.Apply(EnableRelay()) }
DefaultEnableRelay enables relay dialing and listening by default.
var DefaultListenAddrs = func(cfg *Config) error { defaultIP4ListenAddr, err := multiaddr.NewMultiaddr("/ip4/0.0.0.0/tcp/0") if err != nil { return err } defaultIP6ListenAddr, err := multiaddr.NewMultiaddr("/ip6/::/tcp/0") if err != nil { return err } return cfg.Apply(ListenAddrs( defaultIP4ListenAddr, defaultIP6ListenAddr, )) }
DefaultListenAddrs configures libp2p to use default listen address.
var DefaultMuxers = ChainOptions( Muxer("/yamux/1.0.0", yamux.DefaultTransport), Muxer("/mplex/6.7.0", mplex.DefaultTransport), )
DefaultMuxers configures libp2p to use the stream connection multiplexers.
Use this option when you want to *extend* the set of multiplexers used by libp2p instead of replacing them.
var DefaultSecurity = ChainOptions( Security(secio.ID, secio.New), Security(tls.ID, tls.New), )
DefaultSecurity is the default security option.
Useful when you want to extend, but not replace, the supported transport security protocols.
var DefaultTransports = ChainOptions( Transport(tcp.NewTCPTransport), Transport(ws.New), )
DefaultTransports are the default libp2p transports.
Use this option when you want to *extend* the set of transports used by libp2p instead of replacing them.
var NoListenAddrs = func(cfg *Config) error { cfg.ListenAddrs = []ma.Multiaddr{} if !cfg.RelayCustom { cfg.RelayCustom = true cfg.Relay = false } return nil }
NoListenAddrs will configure libp2p to not listen by default.
This will both clear any configured listen addrs and prevent libp2p from applying the default listen address option. It also disables relay, unless the user explicitly specifies with an option, as the transport creates an implicit listen address that would make the node dialable through any relay it was connected to.
var NoTransports = func(cfg *Config) error { cfg.Transports = []config.TptC{} return nil }
NoTransports will configure libp2p to not enable any transports.
This will both clear any configured transports (specified in prior libp2p options) and prevent libp2p from applying the default transports.
var RandomIdentity = func(cfg *Config) error { priv, _, err := crypto.GenerateKeyPairWithReader(crypto.RSA, 2048, rand.Reader) if err != nil { return err } return cfg.Apply(Identity(priv)) }
RandomIdentity generates a random identity. (default behaviour)
Functions ¶
func New ¶
New constructs a new libp2p node with the given options, falling back on reasonable defaults. The defaults are:
- If no transport and listen addresses are provided, the node listens to the multiaddresses "/ip4/0.0.0.0/tcp/0" and "/ip6/::/tcp/0";
- If no transport options are provided, the node uses TCP and websocket transport protocols;
- If no multiplexer configuration is provided, the node is configured by default to use the "yamux/1.0.0" and "mplux/6.7.0" stream connection multiplexers;
- If no security transport is provided, the host uses the go-libp2p's secio encrypted transport to encrypt all traffic;
- If no peer identity is provided, it generates a random RSA 2048 key-pair and derives a new identity from it;
- If no peerstore is provided, the host is initialized with an empty peerstore.
Canceling the passed context will stop the returned libp2p node.
func NewWithoutDefaults ¶
NewWithoutDefaults constructs a new libp2p node with the given options but *without* falling back on reasonable defaults.
Warning: This function should not be considered a stable interface. We may choose to add required services at any time and, by using this function, you opt-out of any defaults we may provide.
Types ¶
type Option ¶
Option is a libp2p config option that can be given to the libp2p constructor (`libp2p.New`).
var DefaultPeerstore Option = func(cfg *Config) error { return cfg.Apply(Peerstore(pstoremem.NewPeerstore())) }
DefaultPeerstore configures libp2p to use the default peerstore.
var Defaults Option = func(cfg *Config) error { for _, def := range defaults { if err := cfg.Apply(def.opt); err != nil { return err } } return nil }
Defaults configures libp2p to use the default options. Can be combined with other options to *extend* the default options.
var FallbackDefaults Option = func(cfg *Config) error { for _, def := range defaults { if !def.fallback(cfg) { continue } if err := cfg.Apply(def.opt); err != nil { return err } } return nil }
FallbackDefaults applies default options to the libp2p node if and only if no other relevant options have been applied. will be appended to the options passed into New.
var NoSecurity Option = func(cfg *Config) error { if len(cfg.SecurityTransports) > 0 { return fmt.Errorf("cannot use security transports with an insecure libp2p configuration") } cfg.Insecure = true return nil }
NoSecurity is an option that completely disables all transport security. It's incompatible with all other transport security protocols.
func AddrsFactory ¶
func AddrsFactory(factory config.AddrsFactory) Option
AddrsFactory configures libp2p to use the given address factory.
func AutoNATServiceRateLimit ¶
AutoNATServiceRateLimit changes the default rate limiting configured in helping other peers determine their reachability status. When set, the host will limit the number of requests it responds to in each 60 second period to the set numbers. A value of '0' disables throttling.
func BandwidthReporter ¶
BandwidthReporter configures libp2p to use the given bandwidth reporter.
func ChainOptions ¶
ChainOptions chains multiple options into a single option.
func ConnectionGater ¶
func ConnectionGater(cg connmgr.ConnectionGater) Option
ConnectionGater configures libp2p to use the given ConnectionGater to actively reject inbound/outbound connections based on the lifecycle stage of the connection.
For more information, refer to go-libp2p-core.ConnectionGater.
func ConnectionManager ¶
func ConnectionManager(connman connmgr.ConnManager) Option
ConnectionManager configures libp2p to use the given connection manager.
func DefaultStaticRelays ¶
func DefaultStaticRelays() Option
DefaultStaticRelays configures the static relays to use the known PL-operated relays.
func DisableRelay ¶
func DisableRelay() Option
DisableRelay configures libp2p to disable the relay transport.
func EnableAutoRelay ¶
func EnableAutoRelay() Option
EnableAutoRelay configures libp2p to enable the AutoRelay subsystem.
Dependencies:
- Relay (enabled by default)
- Routing (to find relays), or StaticRelays/DefaultStaticRelays.
This subsystem performs two functions:
- When this libp2p node is configured to act as a relay "hop" (circuit.OptHop is passed to EnableRelay), this node will advertise itself as a public relay using the provided routing system.
- When this libp2p node is _not_ configured as a relay "hop", it will automatically detect if it is unreachable (e.g., behind a NAT). If so, it will find, configure, and announce a set of public relays.
func EnableNATService ¶
func EnableNATService() Option
EnableNATService configures libp2p to provide a service to peers for determining their reachability status. When enabled, the host will attempt to dial back to peers, and then tell them if it was successful in making such connections.
func EnableRelay ¶
EnableRelay configures libp2p to enable the relay transport with configuration options. By default, this option only configures libp2p to accept inbound connections from relays and make outbound connections _through_ relays when requested by the remote peer. (default: enabled)
To _act_ as a relay, pass the circuit.OptHop option.
func FilterAddresses
deprecated
FilterAddresses configures libp2p to never dial nor accept connections from the given addresses. FilterAddresses should be used for cases where the addresses you want to deny are known ahead of time.
Note: Using Filter + FilterAddresses at the same time is fine, but you cannot configure a both ConnectionGater and filtered addresses.
Deprecated: Please use ConnectionGater() instead.
func Filters
deprecated
Filters configures libp2p to use the given filters for accepting/denying certain addresses. Filters offers more control and should be used when the addresses you want to accept/deny are not known ahead of time and can dynamically change.
Note: You cannot configure both a ConnectionGater and a Filter at the same time. Under the hood, the Filters object is converted to a ConnectionGater.
Deprecated: use ConnectionGater() instead.
func ForceReachabilityPrivate ¶
func ForceReachabilityPrivate() Option
ForceReachabilityPrivate overrides automatic reachability detection in the AutoNAT subsystem, forceing the local node to believe it is behind a NAT and not reachable externally.
func ForceReachabilityPublic ¶
func ForceReachabilityPublic() Option
ForceReachabilityPublic overrides automatic reachability detection in the AutoNAT subsystem, forcing the local node to believe it is reachable externally.
func ListenAddrStrings ¶
ListenAddrStrings configures libp2p to listen on the given (unparsed) addresses.
func ListenAddrs ¶
ListenAddrs configures libp2p to listen on the given addresses.
func Muxer ¶
Muxer configures libp2p to use the given stream multiplexer (or stream multiplexer constructor).
Name is the protocol name.
The transport can be a constructed mux.Transport or a function taking any subset of this libp2p node's: * Peer ID * Host * Network * Peerstore
func NATManager ¶
func NATManager(nm config.NATManagerC) Option
NATManager will configure libp2p to use the requested NATManager. This function should be passed a NATManager *constructor* that takes a libp2p Network.
func NATPortMap ¶
func NATPortMap() Option
NATPortMap configures libp2p to use the default NATManager. The default NATManager will attempt to open a port in your network's firewall using UPnP.
func PrivateNetwork ¶
PrivateNetwork configures libp2p to use the given private network protector.
func Security ¶
Security configures libp2p to use the given security transport (or transport constructor).
Name is the protocol name.
The transport can be a constructed security.Transport or a function taking any subset of this libp2p node's: * Public key * Private key * Peer ID * Host * Network * Peerstore
func StaticRelays ¶
StaticRelays configures known relays for autorelay; when this option is enabled then the system will use the configured relays instead of querying the DHT to discover relays.
func Transport ¶
func Transport(tpt interface{}) Option
Transport configures libp2p to use the given transport (or transport constructor).
The transport can be a constructed transport.Transport or a function taking any subset of this libp2p node's: * Transport Upgrader (*tptu.Upgrader) * Host * Stream muxer (muxer.Transport) * Security transport (security.Transport) * Private network protector (pnet.Protector) * Peer ID * Private Key * Public Key * Address filter (filter.Filter) * Peerstore
Source Files
¶
Directories
¶
Path | Synopsis |
---|---|
p2p
|
|
host/relay
The relay package contains the components necessary to implement the "autorelay" feature.
|
The relay package contains the components necessary to implement the "autorelay" feature. |
net/mock
Package mocknet provides a mock net.Network to test with.
|
Package mocknet provides a mock net.Network to test with. |
test/reconnects
Package reconnect tests connect -> disconnect -> reconnect works
|
Package reconnect tests connect -> disconnect -> reconnect works |