A/B testing

A/B tests split traffic between variant A and variant B, measure outcomes, pick winner. The core unit of experimentation.

Setup

Sample size

Use calculator (VWO, Optimizely). Below-significance results are noise.

Run time

At least one full week to cover weekly cycles.