Mutually exclusive tests
Tests set up so that no visitor is in more than one of them, to keep tests on the same pages from affecting each other.
Also called exclusion group
When two tests change the same page or the same journey, a visitor in both sees a mix of changes, and each test's result includes some of the other's effect. Making them mutually exclusive gives each visitor at most one of the tests.
The cost is traffic: each test gets only its share of the visitors.
A store runs a product-page layout test and a product-page price message test at the same time, each on half the visitors and never on the same person.
Related terms
- Traffic allocationHow much of the eligible traffic enters a test, and how it is divided between the variants.
- BucketingHow a testing tool assigns each visitor to a variant and keeps them there on later visits.
- A/B testAn experiment that shows two versions of a page to randomly split visitors and compares which one performs better on a chosen goal.