How assistants learn about you
When someone asks an AI assistant for 'a good dentist in Tartu' or 'a bakery open on Sunday near me', the assistant answers with a few names. AI products read public websites with automated bots, and the rules for those bots live in a file called robots.txt. Different bots do different jobs.
- GPTBot, ClaudeBot and CCBot mainly collect pages for training AI models.
- Google-Extended controls whether your content is used for certain Google AI features. It does not affect normal Google Search.
- Separate bots, run by some assistants, fetch pages live when a user asks a question.
Allowing is not the same as being recommended
Allowing a bot does not guarantee that any assistant will recommend you. Blocking training bots is a reasonable choice for some businesses. Decide on purpose instead of unblocking everything.
What SiteSignal checks
We check bot access, run a question test for four facts (company, offer, location, contact) using only your site text, and review structure such as titles, headings and business details. Today the test does not cover opening hours, prices or reviews.
What we do not claim
No one outside these companies can see how an assistant chooses its answers. Our AI score is SiteSignal's audit of access and clarity. It is not a ChatGPT ranking, and it does not measure customers you lost.
Three things you can do this week
- Open your robots.txt and confirm the AI bot rules are what you actually want, not leftovers from a template.
- Put your company name, service, area and contact details on your homepage in plain text, not only in images.
- Add a short 'About' paragraph that says who you serve and where.