Data Engineering Portfolio
A real-time + batch crypto pipeline, running live right now.
Everything below is a live Lambda Architecture — a speed layer streaming prices every 2 seconds, a batch layer running dbt-tested transforms every 5 minutes, and a serving layer merging both. Not a screenshot — trigger a pipeline run yourself below.
RedisDuckDBdbtFastAPINext.jsDocker
Live Ticker (Speed Layer)
Waiting for live data... (start stream-ingester container)
Pipeline Health · Manual controls available on each layer card
Market Data
bitcoin — 24h History
ethereum — 24h History
No data yet — run the batch ingester to populate the pipeline
Pipeline Monitoring
No pipeline logs yet — waiting for data...