Generator robots.txt

Gratis - robots.txt generator. Add User-agent groups with Allow / Disallow patterns, an optional Crawl-delay, dan Sitemap URLs to assemble a clean robots.txt — all di browser Anda.