Robots.txt Builder

Build a valid robots.txt — allow/disallow rules per user-agent, sitemap and crawl-delay included.

User-agent: Allow (one per line): Disallow (one per line):

Sitemap URL:

Crawl-delay (sec):

robots.txt appears here…

How to use

Add your allow/disallow rules, set the sitemap URL, and copy a valid robots.txt.

What rules can I add?

One rule-set per user-agent: allowed paths, disallowed paths, plus sitemap and crawl-delay.

Is the output valid?

Yes — clean robots.txt syntax you can upload to your domain root as-is.

☕

Every tool runs 100% in your browser — no uploads, no signups. If a tool saved you time, consider supporting us with a small donation.