TLogz
.
Beta
Home
Categories
AI Tools
About
Browse Tools
Home
Categories
AI Tools
Browse Tools →
Home
/
SEO & Marketing
/ Robots.txt Generator
🤖 Robots.txt Generator
Create a clean, valid robots.txt file with common crawl directives for your website.
Sitemap URL (optional)
Preset Rules
Allow all crawlers
Block GPTBot (OpenAI)
Block CCBot (Common Crawl)
Block ClaudeBot
Disallow /admin/
Disallow /private/
Custom Disallow Paths (one per line)
Generated robots.txt
Copy
Copied!