AI Crawlability Checker by Amrut AI

Check your site's AI Crawlability, agent by agent.

Drop in any URL and see which of 50+ AI crawlers can read your site — and which are locked out.

Free, no signup required.

Checks access across every major AI engine

Meta AI

See exactly who's let in

GPTBot, ClaudeBot, PerplexityBot and 50+ more — know instantly which AI agents can actually crawl your site.

Catch accidental blocks

A stray Disallow rule can quietly cut you out of AI answers for months before anyone notices. We flag it right away.

Protect your AI visibility

Getting crawled is step one. Pair this with Amrut AI's AI Visibility tracking to see how you're actually cited in AI answers.

Process

How it works

1

Enter your domain

Paste any URL — yours, a competitor's, anyone's. No signup required.

2

We read the live robots.txt

We fetch it directly from the site in real time — never cached, never guessed.

3

Get an agent-by-agent report

See allowed, partial, and blocked status for every major AI crawler, instantly.

FAQ

Frequently asked questions