AppliedAIPrep logoAppliedAI/Prep
← Machine Learning & Data Science / 79
hardMetaMicrosoftNetflix

Your A/B test shows the control and treatment groups differ before the treatment even applies. What's wrong?

A pre-existing gap between your groups means randomization or instrumentation is broken, and the whole experiment is suspect. Strong candidates name sample-ratio mismatch on sight. Here is the full diagnosis and the disciplined response.

Updated Aug 2026 · Grounded in real Applied AI Engineer interview loops and written to a senior-engineer editorial bar.

A pre-existing gap between your groups means randomization or instrumentation is broken, and the whole experiment is suspect. Strong candidates name sample-ratio mismatch on sight. Here is the full diagnosis and the disciplined response.

Unlock the other 754 answers · ₹2,000 / $25includes both full courses · progress stays saved · 6 months · one payment · no auto-renew
UP NEXT ON YOUR JOURNEY
Next in this trackYour model is accurate on average but fails badly for one subgroup. How do you find and fix it?Next in this trackYour training loss is oscillating, plateauing, or diverging. How do you debug it?Next in this trackYour training data was collected with selection bias. How do you detect it and correct for it?
DISCUSSION · 0

No comments yet — be the first to share your approach.