bruin

README

Bruin is a data pipeline tool that brings together data ingestion, data transformation with SQL & Python, and data quality into a single framework. It works with all the major data platforms and runs on your local machine, an EC2 instance, or GitHub Actions.

Bruin is packed with features:

• 📥 ingest data with ingestr / Python
• ✨ run SQL & Python transformations on many platforms
• 📐 table/view materializations, incremental tables
• 🐍 run Python in isolated environments using uv
• 💅 built-in data quality checks
• 🚀 Jinja templating to avoid repetition
• ✅ validate pipelines end-to-end via dry-run
• 👷 run on your local machine, an EC2 instance, or GitHub Actions
• 🔒 secrets injection via environment variables
• VS Code extension for a better developer experience
• ⚡ written in Golang
• 📦 easy to install and use

Installation

Please see the installation instructions here.

Community

Join our Slack community here.

Quickstart

Take a look at our quickstart guide here.