Make your site legible to AI crawlers

aicrawl — console

Check if AI can read your site

How AI Crawlability works

agent@repo — aicrawl

# hand-writing llms.txt / robots.txt / sitemap.xml and getting them wrong

agent ~ ▸

~/your-project — install

# in your repo, ask your coding agent:

$ "use the aicrawl skill"

# or install the skill into your repo:

$ npx skills add drmrduck/skills@aicrawl

no browserno zipno signupskill source on GitHub

FAQ

What is llms.txt?

A plain-text file at your site root that tells AI models what your site is and where the good content lives — the AI-era equivalent of robots.txt + sitemap.

Does this touch my repo?

Yes. The agent skill writes the files directly into your project and wires the sitemap route. No zip, no copy-paste.

Related tools
AI Crawlability — Make your site legible to AI crawlers