A/B Testing

A statistical way of comparing two (or more) techniques—the “A” and the “B”—typically an incumbent against a new rival.

A/B testing aims to determine not only which technique performs better but also to understand whether the difference is statistically significant.

A/B testing usually considers only two techniques using one measurement, but it can be applied to any finite number of techniques and measurements.