Explore
Career Tracks
Micro Free Courses
Task Courses
Practice
Interview Practice
Work Experience
Projects
Career Track
Blog
Support
INR
Sign in
Micro Free Courses
Stats & Product Analytics for Analysts
68 lessons
1. Stats You Can Actually Use
Video lesson
1. Mean, Median & Mode - Why Averages Lie
10m
Reading
2. When Averages Lie
5m
Interactive tutorial
3. When Averages Lie Quiz
3m
Video lesson
4. Variance, Standard Deviation & Percentiles
11m
Reading
5. Reading Spread Like an Analyst
5m
Interactive tutorial
6. Reading Spread Like an Analyst Quiz
3m
Video lesson
7. Distributions That Matter in DA Work
12m
Reading
8. Spotting the Shape
5m
Interactive tutorial
9. Spotting the Shape Quiz
3m
Video lesson
10. Sampling Intuition - Why Sample Size Matters Less Than You Think
10m
Reading
11. Spotting Sampling Bias
5m
Interactive tutorial
12. Spotting Sampling Bias Quiz
3m
2. Reading Inference Without Doing the Math
Video lesson
1. P-values & Null Hypothesis - What They Actually Mean
12m
Reading
2. Reading P-values Without Getting Fooled
6m
Interactive tutorial
3. Reading P-values Without Getting Fooled Quiz
4m
Video lesson
4. Confidence Intervals - The Most Useful Thing in Applied Stats
10m
Reading
5. Reading Confidence Intervals
5m
Interactive tutorial
6. Reading Confidence Intervals Quiz
3m
Video lesson
7. Type I vs Type II Errors - False Positives, False Negatives
9m
Reading
8. Which Error Costs You More?
5m
Interactive tutorial
9. Which Error Costs You More? Quiz
3m
Video lesson
10. Statistical vs Practical Significance
8m
Reading
11. Statsig vs Shipsig
5m
Interactive tutorial
12. Statsig vs Shipsig Quiz
3m
Video lesson
13. Five Stats Traps That Will Fool You
14m
Reading
14. The Five Traps
8m
Interactive tutorial
15. The Five Traps Quiz
4m
3. Thinking in Product Metrics
Video lesson
1. North-Star Metrics - What They Are and Aren't
9m
Reading
2. Picking a Good North Star
5m
Interactive tutorial
3. Picking a Good North Star Quiz
3m
Video lesson
4. AARRR - Pirate Metrics for Product Analytics
8m
Reading
5. Applying AARRR in Practice
5m
Interactive tutorial
6. Applying AARRR in Practice Quiz
3m
Video lesson
7. Leading vs Lagging Indicators
8m
Reading
8. Optimize vs Monitor
5m
Interactive tutorial
9. Optimize vs Monitor Quiz
2m
Video lesson
10. Funnel Analysis - Finding Where Users Drop Off
10m
Reading
11. Reading Funnels Like an Analyst
6m
Interactive tutorial
12. Reading Funnels Like an Analyst Quiz
3m
Video lesson
13. Cohort Retention Curves - Smiling, Flat, Leaky
10m
Reading
14. Reading Cohort Curves
6m
Interactive tutorial
15. Reading Cohort Curves Quiz
4m
4. A/B Testing in Practice
Video lesson
1. Why A/B Test At All
11m
Reading
2. When to Test, When Not To
5m
Interactive tutorial
3. When to Test, When Not To Quiz
3m
Video lesson
4. Designing an A/B Test - Hypothesis to Guardrails
10m
Reading
5. The Test Design Checklist
6m
Interactive tutorial
6. The Test Design Checklist Quiz
4m
Video lesson
7. Sample Size & Minimum Detectable Effect - The Napkin Version
10m
Reading
8. Sample-Size Napkin Math
5m
Interactive tutorial
9. Sample-Size Napkin Math Quiz
3m
Video lesson
10. Reading A/B Test Results
10m
Reading
11. Anatomy of an A/B Test Result
5m
Interactive tutorial
12. Anatomy of an A/B Test Result Quiz
3m
Video lesson
13. Why Experiments Go Wrong - Five Failure Modes
12m
Reading
14. The Five Failure Modes
6m
Interactive tutorial
15. The Five Failure Modes Quiz
4m
5. Bringing It Together
Reading
1. Case Study A - Signup Conversion Dropped 8% Last Week
13m
Interactive tutorial
2. Case Study A - Signup Conversion Dropped 8% Last Week Quiz
7m
Reading
3. Case Study B - Should We A/B Test This Redesign?
13m
Interactive tutorial
4. Case Study B - Should We A/B Test This Redesign? Quiz
7m
Reading
5. Your Analyst Checklists - Reusable Mental Models
6m
Interactive tutorial
6. Your Analyst Checklists - Reusable Mental Models Quiz
4m
Project submission
7. Warm-Up Rep - Practice Before the Milestone Project
50m
6. Deep Dive: CLT & Metric Trees
Reading
1. Standard Error & the CLT, In Plain English
8m
Interactive tutorial
2. Standard Error & the CLT, In Plain English Quiz
4m
Reading
3. Metric Trees: Decomposing 'Why Did X Change'
8m
Interactive tutorial
4. Metric Trees: Decomposing 'Why Did X Change' Quiz
4m
Browse Topfolio
All courses
Practice
Projects
Career tracks
Home
/
Courses
/
Stats & Product Analytics for Analysts
/
A/B Testing in Practice
/
When to Test, When Not To Quiz
Back to A/B Testing in Practice
When to Test, When Not To Quiz
Test what you just read.
3 minutes
Interactive tutorial
Loading lesson...
