Stats & Product Analytics for Analysts
Back to Bringing It Together

Case Study B - Should We A/B Test This Redesign?

A PM wants to A/B test a major redesign. Decide whether the test is worth running or whether to just ship.

3 minutesReading
🎯 Free Guest Mode: You are learning for free. Sign in to save your completion progress and quiz answers.

The situation

A PM at your company is pushing for a major homepage redesign. The proposal:

  • Current homepage: 2.8% conversion.
  • New homepage mocked up after 3 months of design.
  • Traffic: 3,000 visitors per day.
  • CEO has publicly committed to launching in 6 weeks.

Your job

Assess whether this should be an A/B test or an observability staged rollout, calculate sample sizing requirements, and frame your recommendation for leadership.

Loading progress...