Robots.txt Allow Tester

Test any URL path against your robots.txt rules to see exactly what crawlers may access.

—

How to use

Paste your robots.txt, pick a user-agent, enter a path to test, and see Allow or Disallow instantly.

Which rules are supported?

Allow/Disallow with * wildcards and $ end-anchors, per user-agent groups.

Does it fetch robots.txt live?

No — paste your robots.txt content; the matching engine runs locally.

☕

Every tool runs 100% in your browser — no uploads, no signups. If a tool saved you time, consider supporting us with a small donation.