WordPress Robots.txt Generator
Copy-ready robots.txt templates for every WordPress setup — default, WooCommerce, Multisite and Yoast. Each one is render-safe and loads straight into our full Robots.txt Generator so you can fine-tune AI-bot blocking and crawl rules.
Pick the template that matches your site, replace the example Sitemap: line with your real sitemap URL, and paste it into your SEO plugin or upload it to your site root. Need to block AI crawlers or add custom rules? Hit “Load in Generator” to open it in the full editor.
Default WordPress
Load in GeneratorThe safe, render-friendly baseline for any standard WordPress site. Blocks the admin area and internal search, allows admin-ajax.php, and links your sitemap.
WordPress + WooCommerce
Load in GeneratorAdds protection for store pages and faceted filter URLs. Keeps crawlers off cart, checkout, account and ?orderby/?filter parameter URLs that waste crawl budget.
WordPress Multisite
Load in GeneratorFor network installs. Blocks the shared admin plus the signup and activation endpoints that should never be crawled or indexed across the network.
WordPress + Yoast SEO
Load in GeneratorTuned for Yoast users: blocks reply-to-comment query strings and trackbacks, and points to the Yoast sitemap index. Edit this right inside Yoast → Tools → File editor.
Getting WordPress robots.txt right in 2026
WordPress ships a virtual robots.txt — a default file generated on the fly that you never see in your file manager. It works, but it is minimal and you cannot customize it without overriding it. The moment you add WooCommerce, run a Multisite network, or want to control the wave of AI crawlers harvesting content, you need a real file.
The two rules that matter most: never block your assets (don\'t disallow /wp-content/, CSS or JS — Google renders your pages and needs them), and always allow /wp-admin/admin-ajax.php even while blocking the rest of /wp-admin/. Every template above already does both. Replace the sitemap line, publish, and confirm it in Google Search Console.
- Render-safe — assets stay crawlable
- admin-ajax.php allowed on every template
- WooCommerce filter & cart URLs handled
- One-click handoff to AI-bot blocking