Five weeks ago, I had an interview at CHECK24 Vergleichsportal GmbH for a Junior Analyst role (https://lnkd.in/eAFqHKbu). I was asked a fantastic, in-depth A/B testing question:
"Imagine running an email campaign with a 3% discount. How do you know if it's worth it? How do you design the test, determine the sample size, and decide on the duration?"
The question inspired me to go deep and create the ultimate A/B testing guide for myself. It covers everything from initial ideation (Phase 0) to analyzing results, including a detailed answer to the exact question I was asked.
I believe in learning in public, so I'm sharing my comprehensive notes with all of you. You'll find a complete framework, common "gotchas", and the key differences between classic NHST and decision-theory.
Find the full guide attached as a PDF in my LinkedIn. I hope it helps you ace your next interview!
Top comments (0)