Python + ClickHouse + Kafka: Data Warehouse ETL Pipeline
A data engineering ETL/ELT pipeline: Python for its rich data-tooling ecosystem, Kafka as the ingestion backbone decoupling producers from processing, and ClickHouse as the analytical warehouse built for fast aggregate queries over large volumes.
Loads this recipe straight into the wizard — every setting stays editable before you generate anything.
The stack
Install
# pulls this exact recipe straight from the Vault $ npx stacktora install python-etl-warehouse --remote $ stacktora sync # generate the files
What you get
More from the Vault
Go + ClickHouse + Kafka
An event-ingestion pipeline: a Go API publishing to Kafka, with ClickHouse as the analytics store.
Rust + Kafka + ClickHouse: IoT Telemetry Ingestion
A high-throughput device telemetry pipeline: a Rust ingestion API built for low-latency, high-volume writes, Kafka absorbing bursty device traffic, and ClickHouse as the analytical store for time-series queries at scale.
.NET + Postgres + Redis: Fintech-oriented Baseline
A security-conscious starting point for financial and payments-adjacent backends: .NET API, Postgres for ledger/transaction records, and Redis for session and rate-limit state. This is a starting baseline only, not a certified or verified PCI-DSS/regulatory-compliant stack — your own security and compliance review is still required before handling real financial data.
Bun + MongoDB + Meilisearch: Knowledge Base / Docs Search
A documentation/knowledge-base platform: Bun API for fast cold starts and low-latency responses, MongoDB for flexible article/page storage, and Meilisearch for instant, typo-tolerant search across the whole knowledge base.