Robots.txt Generator — Free Online Tool

Robots.txt Generator

Pick a preset, fine-tune the rules, then copy or download a production-ready robots.txt for your WordPress site — no signup required.

1. Choose a preset Sets the baseline policy for search engines and AI crawlers.

WordPress Standard Search-friendly defaults: admin and search results blocked, everything else open. GEO / AI-Friendly Explicitly allows GPTBot, ClaudeBot, PerplexityBot & other AI crawlers for LLM visibility. Strict Protection Only major search engines crawl the site; AI, training and SEO bots are blocked.

2. Sitemap Helps search engines discover your content faster.

Sitemap URL(s)

Separate multiple sitemaps with spaces, commas or new lines. Example: https://example.com/post-sitemap.xml https://example.com/page-sitemap.xml

Robots.txt Generator — Free Online Tool