neptunus

module
v1.0.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 14, 2024 License: Apache-2.0

README

Neptunus

Neptunus is a data processing engine for consuming, transforming and producing events. Originally conceived as a central unit of a mediation platform, Neptunus may:

  • receive data from a number of different sources, either from message brokers or by acting as a server
  • manage event streams based on filtering rules
  • transform, enrich and create new events
  • deliver events to consumers in various formats and protocols

Neptunus is based on data processing pipelines - a compositions of six types of plugins:

  • Inputs consume events from external sources
  • Processors transform events
  • Outputs produce events to external systems
  • Filters route events in pipeline by conditions
  • Parsers convert raw data into events
  • Serializers convert events into data formats for external systems

Configuration

Neptunus configuration has two parts - daemon config and pipelines.

See more in our documentation.

Getting Started

Get help:
neptunus --help
Run daemon:
neptunus run --config config.toml
Test pipelines configuration:
neptunus test --config config.toml
Get help about cli tool usage:
neptunus pipeline --help

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL