robots.txt Generator

Gratis robots.txt generator. Add User-agent groups with Allow / Disallow patterns, an optional Crawl-delay, and Sitemap URLs to assemble a clean robots.txt — all in uw browser.