Spark Lakehouse
Medallion Build
Build a Bronze -> Silver -> Gold medallion lakehouse with PySpark + Delta Lake on local Docker: deduped Silver, Gold marts, quality gates, time travel, and CI — fully local, no shared infra, the Week-9 Spark theory hardened into a portfolio repo.
What you'll learn
- —Run PySpark + Delta Lake on local Docker (own machine only)
- —Build Bronze/Silver/Gold layers with schema enforcement
- —Gate Silver with dedup + null + range quality checks
- —Use Delta time travel + VACUUM and explain the tradeoff
The 5 milestones
Each milestone is reviewed before you advance.
- 01
Local Docker Spark + repo scaffold
Compose stack boots Spark; repo layout runs a smoke job.
- 02
Bronze ingest to Delta
Raw fixtures land as append-only versioned Bronze.
- 03
Silver + Gold medallion
Deduped Silver, Gold marts, schema enforcement on.
- 04
Quality gates + time travel
Failing gates block Gold; time travel + vacuum demonstrated.
- 05
CI + README + demo
Green CI on every push, portfolio README, recorded demo.
Reading & references
Build your portfolio & get certified
Want more projects like this? Join our Data Analyst Work Experience Program to complete 5+ guided industry projects, gain real experience, and earn an internship certificate.
Free Spark Lakehouse Medallion Build portfolio project — with AI review
Build a real spark lakehouse medallion build project for your data analyst portfolio in your own public GitHub repo — free brief, starter template, and milestone guides. When your code is ready, the Free pass gets every milestone reviewed against a fixed rubric (de spark lakehouse medallion walkthrough included) and issues a verifiable certificate on completion.
Is the Spark Lakehouse Medallion Build project free?
The full project brief, milestone guides, and starter template are free to audit. The AI-powered review pass and verified certificate unlock at Free.
Can I add the Spark Lakehouse Medallion Build project to my resume and GitHub?
Yes — that is the point. You build in your own public GitHub repo, every milestone is reviewed against a fixed rubric, and the certificate links to the repo employers can inspect. Only list what is visible in your repo.
How long does the Spark Lakehouse Medallion Build project take?
Most students finish the 5 milestones in 2–4 weekends. Milestones unlock in order, and you can re-submit any milestone that needs work.
Rubric-reviewed · Plagiarism-checked · Verifiable certificate