thinQmaster Virtual testing partner Adaptive practice exams that find your weak spots and drill them. Every answer explained. From $69
Enroll

thinQmaster

Find your exam

Five questions free, before you decide.

Step 1 · choose a vendor

In one of our camps? Your practice exams come with the tuition — they are on your study page already.

DevOps & Automation · Foundational

A/B Testing

Experimentation that serves different variants to user groups and compares business metrics to decide which performs better.

Definition

A/B tests measure user behavior such as conversion, using statistically valid splits. They differ from canaries, which measure technical health of a release.

Example

Half of users see a green 'Buy' button and half a blue one; the variant with higher conversion wins.

Exam tip

A/B testing answers business questions; canary deployments answer 'is this release safe?'

Related terms