What is a control group?
A control group is a set of pages, prompts, or queries left untouched by a change, measured alongside the ones you did change, so you can tell whether a shift in results came from your action or from something else entirely.
Say you rewrite a product page and, two weeks later, its citation rate is up. Was it the rewrite? Or did the underlying model get updated in that window, or did the topic get more attention generally, or did your prompt basket just land differently that week? Without a control group, pages or prompts you deliberately left alone, there's no way to separate your change from everything else moving at the same time.
In AI visibility work, the biggest uncontrolled variable is the model itself. Providers update models and retrieval systems on their own schedule, and those updates shift citation patterns across the board, unrelated to anything a given brand did. A control group of untouched pages, tracked over the same window as the pages you edited, is what lets you attribute a change to your edit rather than to a shift happening underneath everyone at once.
This is easy to skip because it doubles the measurement work, you're tracking two sets instead of one. But a before-and-after number on a single changed page, with no control, is a story, not evidence.
Related
- BaselineA baseline is the measurement taken before a change, used as the fixed point everything after it gets compared against.
- A/B testAn A/B test compares two versions of something by splitting exposure between them, but for AI visibility the split rarely happens the way it does for a webpage, so most before-and-after comparisons of AI citations are not actually A/B tests.
- Model driftModel drift is when an engine's answers change because the provider changed the model behind it, not because anything about your brand changed.
- Share of voiceShare of voice is the proportion of AI answers in a category that name your brand, relative to the competitors named alongside you.
Want to know where you actually stand on this? Run a free visibility check or try the free tools.