Stats &amp; Product Analytics for Analysts

When Averages Lie

When Averages Lie Quiz

Variance, Standard Deviation & Percentiles

11 min

Reading Spread Like an Analyst

Reading Spread Like an Analyst Quiz

Distributions That Matter in DA Work

12 min

Spotting the Shape

Spotting the Shape Quiz

Sampling Intuition - Why Sample Size Matters Less Than You Think

Spotting Sampling Bias

Spotting Sampling Bias Quiz

P-values & Null Hypothesis - What They Actually Mean

Reading Inference Without Doing the MathFREE PREVIEW

P-values, confidence intervals, Type I/II errors, statsig vs shipsig, and the five stats traps that fool analysts daily.

100 min15 lessons

12 min

Reading P-values Without Getting Fooled

Reading P-values Without Getting Fooled Quiz

Confidence Intervals - The Most Useful Thing in Applied Stats

Reading Confidence Intervals

Reading Confidence Intervals Quiz

Type I vs Type II Errors - False Positives, False Negatives

9 min

Which Error Costs You More?

Which Error Costs You More? Quiz

Statistical vs Practical Significance

Statsig vs Shipsig

Statsig vs Shipsig Quiz

Five Stats Traps That Will Fool You

Thinking in Product MetricsFREE PREVIEW

North-star metrics, AARRR, leading vs lagging, funnel analysis, cohort retention. The product-analytics frames every DA must know.

90 min15 lessons

North-Star Metrics - What They Are and Aren't

9 min

Picking a Good North Star

Picking a Good North Star Quiz

AARRR - Pirate Metrics for Product Analytics

Applying AARRR in Practice

Applying AARRR in Practice Quiz

Leading vs Lagging Indicators

Optimize vs Monitor

Funnel Analysis - Finding Where Users Drop Off

Optimize vs Monitor Quiz

2 min

Reading Funnels Like an Analyst

Reading Funnels Like an Analyst Quiz

Cohort Retention Curves - Smiling, Flat, Leaky

Reading Cohort Curves

Reading Cohort Curves Quiz

When to Test, When Not To

A/B Testing in PracticeFREE PREVIEW

When to test, how to design the test, sample-size napkin math, reading results, and the five failure modes that ruin experiments.

100 min15 lessons

Why A/B Test At All

11 min

When to Test, When Not To Quiz

Designing an A/B Test - Hypothesis to Guardrails

The Test Design Checklist

The Test Design Checklist Quiz

Sample Size & Minimum Detectable Effect - The Napkin Version

Sample-Size Napkin Math

Sample-Size Napkin Math Quiz

Reading A/B Test Results

Anatomy of an A/B Test Result

Anatomy of an A/B Test Result Quiz

Why Experiments Go Wrong - Five Failure Modes

12 min

The Five Failure Modes

The Five Failure Modes Quiz

Case Study A - Signup Conversion Dropped 8% Last Week

Bringing It TogetherFREE PREVIEW

Two case studies, a reusable analyst checklist, and a warm-up rep: analyze a small A/B test before doing it for real on the milestone project.

180 min7 lessons

13 min

Case Study A - Signup Conversion Dropped 8% Last Week Quiz

7 min

Case Study B - Should We A/B Test This Redesign?

13 min

Case Study B - Should We A/B Test This Redesign? Quiz

7 min

Your Analyst Checklists - Reusable Mental Models

Your Analyst Checklists - Reusable Mental Models Quiz

Warm-Up Rep - Practice Before the Milestone Project

50 min

Standard Error & the CLT, In Plain English

Deep Dive: CLT & Metric TreesFREE PREVIEW

Optional. Name the statistics you've been running silently since Module 0 (standard error / the Central Limit Theorem), and turn Case Study A's decomposition reasoning into a reusable metric-tree template.

24 min4 lessons

Standard Error & the CLT, In Plain English Quiz

Metric Trees: Decomposing 'Why Did X Change'

Metric Trees: Decomposing 'Why Did X Change' Quiz