How to Let ChatGPT Read Your Site
OpenAI runs three crawlers and only one of them decides whether you appear in answers.
How to Let Google's AI Read Your Site
AI Overviews live inside Search, so the control isn't the one most people reach for.
How to Let Perplexity Read Your Site
Two settings decide whether PerplexityBot gets in. Both take a minute to check.
How to Let Claude Read Your Site
Anthropic runs three crawlers. Blocking the training one costs you nothing.
How to Let Microsoft Copilot Read Your Site
There's no AI-only switch here: one crawler feeds both Copilot and Bing search.
How to Let Meta AI Read Your Site
Five crawlers, easy to confuse, and one of them controls your link previews.
How to Let Apple Intelligence Read Your Site
One of Apple's two names isn't a crawler at all, which catches almost everyone out.
Robots.txt: How to Stop Blocking Pages You Want Found
A three-line file decides where crawlers may go. One stale rule can hide your services.
XML Sitemaps: Why AI Assistants Need One and How to Add It
Without a sitemap, pages nobody links to may never be visited at all.
Noindex and Nosnippet: Why Your Pages May Be Hidden From AI Answers
A tag left on after launch keeps a perfectly good page out of every answer.
JavaScript Menus: Why AI Assistants Can't Follow Them
If your menu isn't made of real links, everything behind it stays unvisited.
Broken Links: How to Find and Fix Them on Your Site
A dead link ends the path and takes everything behind it along with it.
Canonical Tags: How a Wrong One Hides Your Page
One line can tell assistants your page is a copy of something else.
JavaScript Text: Why AI Assistants See an Empty Page
Your words are there for visitors and missing from the file crawlers read.
Login Walls, Paywalls and Cookie Banners: What AI Assistants See
No assistant can sign in or click “I accept”. Behind that, nothing exists.
Server Response Time: Why AI Assistants Give Up on Slow Sites
Crawlers don't wait. Slow answers mean fewer pages read, less often.
Blocked CSS and JavaScript: Why Your Page Looks Broken to AI
The page opens, but the files it needs in order to display don't.