Micro Free Course — 100% Free Learning
All lessons in this module are free to learn. Sign in with Google to save your progress.
Live DE Cases
Six end-to-end pipeline walkthroughs: build an ingest→dbt→dashboard pipeline; design CDC from OLTP to warehouse; add data quality + alerting; convert batch to near-real-time; refactor a flaky pipeline to idempotent; migrate to an open lakehouse on Iceberg.
Module Content
Case 1 — Build an End-to-End Pipeline (Ingest → dbt → Dashboard)
Build a working batch pipeline from scratch: source → ingestion → dbt models → dashboard. The DE rite of passage.
Case 2 — Postgres CDC to Warehouse (Real-Time Replication)
Set up CDC (Change Data Capture) from a Postgres OLTP database to your warehouse. The pattern every real DE has built.
Case 3 — Data Quality Failure Investigation
A broken pipeline scenario: dashboard shows wrong numbers. Walk the layers, find the root cause, fix and add tests.
Case 4 — Batch to Streaming Migration
A hourly batch pipeline needs sub-minute freshness. Migrate it carefully without breaking downstream.
Case 5 — Idempotency Refactor
A pipeline produces duplicates on retry. Refactor it to be properly idempotent. Test by retrying multiple times.
Case 6 — Lakehouse Migration (Move Data to Iceberg)
Move a warehouse table to Iceberg-format lakehouse. Reconcile both paths; cut over downstream.