Definition
Crawlability is how easily crawlers, from search engines and increasingly from AI assistants, can discover and fetch a site's pages. A page that can't be crawled can't be indexed or cited.
What affects it
- robots.txt rules that allow or block crawlers.
- Internal links: pages with no links pointing to them are hard to find.
- Sitemaps that list the pages you want found.
- Server responses: errors, timeouts and redirect chains.
- Rendering: content that only appears after JavaScript runs is invisible to crawlers that don't run it, including most AI assistants.
How to check it
Test your robots.txt rules for each crawler with the AI crawler checker. To see what crawlers actually fetch, and which requests failed, read your server's traffic; LogZuno's AI visibility reports errors served to AI agents.