Robots.txt Generator

Build a valid robots.txt with allow/disallow rules, crawl-delay and sitemap — copy or download instantly.

User-agent: Disallow paths (one per line): Allow paths (one per line): Crawl-delay (seconds, 0 = none): Sitemap URL:

—

How to use

Enter the user-agent, one disallow path per line, optional allow paths, crawl-delay and your sitemap URL. Click Generate, then copy or download.

What does robots.txt do?

It tells search-engine crawlers which pages they may or may not crawl on your site.

Will it block my site from Google?

Only if you disallow everything (Disallow: /). Review the output before uploading.

Is it free?

Yes, free, no signup.

☕

Every tool runs 100% in your browser — no uploads, no signups. If a tool saved you time, consider supporting us with a small donation.