84%
What it means
Ask ChatGPT "best CRM for a small team" today and again tomorrow. You'll probably get a different answer. Not completely different, but some brands drop out, new ones come in, and the order shifts.
That's AI answer volatility. It's why a single check of an AI answer, good or bad, tells you very little.
How much answers change
We asked the same 210 questions on four engines on two days in a row. Then we compared each answer with the day before.
- 84% of answers named a different set of brands.
- 27% of the brands named on day one were gone on day two.
- Only 42% of cited pages were the same.
Some engines change more than others. Gemini changed 95% of its answers. ChatGPT 88%, Google AI Mode 84% and AI Overviews 67%.
Why it happens
- Models pick words with some randomness. Two runs of the same question can go different ways.
- The searches behind the answer change. The AI splits a question into smaller searches (query fan-out), and each run can pick different ones.
- The web changes. Lists get updated, new pages rank, old ones drop.
Who it hits hardest
Leaders are steadier. A brand ranked #1 was named again the next day 90% of the time. A brand ranked sixth or lower: 61%. Brands that show up in a lot of answers in their category kept 73% of their spots. Brands that show up less kept 51%.
So if you're a smaller brand, your AI visibility will look jumpy. That's normal. The trend over weeks is what counts.
Example
A note-taking app checks ChatGPT on Monday and is named third. On Tuesday it's missing. On Wednesday it's back, in fifth.
None of those days is "the truth". Across 30 questions and 30 days, it's named in 38% of answers. That number is stable enough to act on.
Frequently asked questions
Can I stop my answers from changing?
No one can. But you can be in more of them. A brand on three or more of the lists an engine read was recommended in 44% of those answers. On just one list: 22%.
How often should I check?
Daily, if you can, and across many questions. Our data shows a single day's answer is often different from the next day's, so a weekly spot check can mislead you.
Which engine is the most stable?
Google AI Overviews changed the least, 67% of answers in a day. ChatGPT kept the same top pick most often, 71% of the time.