README
¶
ntail streams
ntail streams is currently in pre-alpha and is not ready for production use.
ntail streams is a fast message broker written in Go that uses Google BigQuery as a storage backend.
Roadmap
- Design improvements for scalability:
- Improved coordination buffer nodes for picking up assigning hash ranges.
- Improved coordination when subscribers pick up bookmarks.
- Access Control
Installation
Helm
helm repo add bitnami https://charts.ntail.io/ntail
helm install ntail-streams ntail/streams
Why use ntail streams
Simplicity
By storing messages directly in BigQuery, you have a shorter data pipeline and quicker insights.
Cost savings
By utilizing cheap BigQuery storage, cost the is a fraction of other SaaS solutions.
Sub-millisecond response times
ntails streams stores the tail of each topic in memory to serve messages blazingly fast.
Faster insights
Messages are accessible on BigQuery atomically. This means you have access to real-time analytics, not near time analytics.
No partitions
Ntail streams has no fixed partitions, instead messages are grouped by segments dynamically (this feature is not yet implemented).
Ordering guarantee
ntail streams messages are ordered sequentially by key. This makes it excellent to use for communication in a microservice architecture.
Infinite retention without compromises
Unlike other message brokers there is no limit to the amount of data that can be stored.
Directories