Can AI assistants see your website?
More people now ask ChatGPT, Claude or Perplexity which business to choose. If their crawlers can't read your site, you can't be recommended. Type your address and see what they see.
- •robots.txt rules for 7 AI crawlers
- •Firewall blocks for GPTBot, ClaudeBot and PerplexityBot
- •Readable text, structured data, llms.txt and sitemap
How AI assistants find businesses
Crawlers read your pages
OpenAI, Anthropic, Perplexity and Google send their own bots. robots.txt and firewalls decide if they get in.
They read plain HTML
Most AI crawlers don't run JavaScript. Text that only appears after scripts run is invisible to them.
Structured data helps
Schema markup tells them clearly who you are, where you work and what you offer.
llms.txt is a shortcut
A short text file that lists your key pages for AI tools, like a sitemap written for them.
What we check
- Which AI crawlers your robots.txt allows or blocks
- Whether your firewall turns AI crawlers away
- Text on the page without JavaScript
- Structured data (schema.org)
- llms.txt, sitemap, title and description
- A noindex tag that hides the page
Questions
Should I block AI training bots?
It's your choice. Training bots like GPTBot or CCBot use content to train models. Search and user bots like OAI-SearchBot, ChatGPT-User and PerplexityBot fetch pages to answer questions and link to you. Blocking those means you can't be cited.
My site is blocked but I never changed anything.
Many hosts and firewalls, including some Cloudflare settings, block AI bots by default. The check shows it, and it's usually one switch to change.
Does this guarantee ChatGPT will recommend me?
No. It checks that AI tools can read you. Being recommended also depends on reviews, other sites mentioning you and clear, useful content.
Is anything stored?
No. We read your public pages once to build the report and keep nothing.
Want AI assistants to recommend you?
You get a reply within one working day with a clear scope and a price. No sales team, you talk to the engineer who builds it.
