Streaming Mini-Lab
Simulate an event stream (Kafka-style log or socket feed), apply windowed aggregations with watermarks for late data, and serve a Bronze/Silver/Gold mini-lakehouse with exactly-once-ish dedup semantics.
What you'll learn
- —Produce + consume an append-only event log
- —Apply tumbling-window aggregations with watermarks
- —Handle late/out-of-order events explicitly
- —Serve Bronze/Silver/Gold layers with deduped keys
The 4 milestones
Each milestone is reviewed before you advance.
- 01
Event feed + Bronze landing
Simulated stream lands append-only Bronze with event time.
- 02
Silver dedup + watermarks
Deduped Silver with watermark policy for late data.
- 03
Gold windowed aggregates
Tumbling-window Gold marts over event time.
- 04
Ops note + README + demo
Failure drill, ops note, portfolio README, recorded demo.
Reading & references
Build your portfolio & get certified
Want more projects like this? Join our Data Analyst Work Experience Program to complete 5+ guided industry projects, gain real experience, and earn an internship certificate.
Free Streaming Mini-Lab portfolio project — with AI review
Build a real streaming mini-lab project for your data analyst portfolio in your own public GitHub repo — free brief, starter template, and milestone guides. When your code is ready, the Free pass gets every milestone reviewed against a fixed rubric (de streaming mini lab walkthrough included) and issues a verifiable certificate on completion.
Is the Streaming Mini-Lab project free?
The full project brief, milestone guides, and starter template are free to audit. The AI-powered review pass and verified certificate unlock at Free.
Can I add the Streaming Mini-Lab project to my resume and GitHub?
Yes — that is the point. You build in your own public GitHub repo, every milestone is reviewed against a fixed rubric, and the certificate links to the repo employers can inspect. Only list what is visible in your repo.
How long does the Streaming Mini-Lab project take?
Most students finish the 4 milestones in 2–4 weekends. Milestones unlock in order, and you can re-submit any milestone that needs work.
Rubric-reviewed · Plagiarism-checked · Verifiable certificate