What is A/B testing?

An experiment comparing variants through random assignment and outcome measurement.

This term concerns the evidence, analysis, automation or intelligence used to improve commercial decisions while maintaining appropriate controls. In practice, A/B testing should be defined clearly enough that the people responsible for the relevant decisions can apply it consistently, recognise its limits and identify the evidence needed to evaluate it.

When this concept is unclear or disconnected from the wider revenue environment, teams can make locally reasonable decisions that create friction elsewhere. A useful application makes ownership, dependencies, expected outcomes and trade-offs more visible.

Consider how A/B testing affects the movement from strategy and demand through conversion, customer value, expansion and continuous improvement. The relevant people, processes, technology, data and governance should support the intended commercial outcome rather than operate as an isolated capability.

Commercial Architecture examines the relationships between strategy, people, process, technology, data and governance. A/B testing is one part of that wider design. It should not be treated as evidence of a complete Governed Revenue System by itself.

The practical meaning of A/B testing depends on the role using it. Executives need to understand its effect on direction, risk and investment; commercial leaders need to connect it to performance and accountability; and specialist teams need clear processes, information and decision rights for operating it.