What they are
Every visit to your site is recorded in server logs, with a "user agent" naming the visitor. AI bots name themselves: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, CCBot and others.
What they tell you
- Which bots visit, and whether ones you want are missing.
- Which pages they read. Are they reading pricing and product pages, or only old blog posts?
- How often. A spike in ChatGPT-User visits can mean ChatGPT is opening your pages to answer people's questions.
- Errors. Bots hitting broken pages or blocked areas.
How to see them
Your hosting provider or CDN (like Cloudflare) usually has logs or bot reports. Filter by user agent.
Watch for fakes
Anyone can claim to be GPTBot. The big AI companies publish their bots' IP ranges, so you can check whether a visit really came from them.
Example
A company checks its logs and sees GPTBot and ClaudeBot visiting daily, but no OAI-SearchBot at all. Its robots.txt turns out to block it. After fixing it, OAI-SearchBot visits start, and so do ChatGPT citations.
Frequently asked questions
Do AI crawler visits mean AI recommends me?
No. They mean AI is reading you. Recommendations depend on what the pages it reads say.
What does ChatGPT-User traffic mean?
ChatGPT opened your page live to answer someone's question. It's a sign your page is being used in answers.
Can too many bot visits slow my site?
On small servers, sometimes. Rate limits or a CDN can help.