Robots.txt Generator (Free Online SEO Tool)
Create crawler directive files with custom Disallow rules, XML sitemap paths, and optional AI scraper blocks for GPTBot and ClaudeBot.
Robots Directives
Default Search Crawlers (Google, Bing)
XML Sitemap URL
Custom Disallow Directories (One per line)