robots.txt Generator

Free robots.txt generator. Add User-agent groups with Allow / Disallow patterns, an optional Crawl-delay, and Sitemap URLs to assemble a clean robots.txt — all in your browser.