AI Crawl Audit№ 001
A free tool · 2026 edition
See how AI engines
read your website.
Three checks — robots.txt, llms.txt, and structured data — aggregated into one score. Free, instant, no signup.
What we check
01
robots.txt
We test every known AI crawler against your robots.txt — training bots, AI search bots, and user-fetch bots — using RFC 9309 semantics.
02
llms.txt
A new convention for telling AI engines what your site is and where to find the important pages. We check spec compliance per llmstxt.org.
03
Structured data
Schema.org JSON-LD is how AI engines identify who you are and what kind of content you publish. We extract every block on your homepage and validate.