IndexVexa
Free SEO Tools

Robots.txt Generator

Build a valid robots.txt from simple User-agent/Allow/Disallow rules, starting from a preset or from scratch.

Presets

Rule 1

Generated robots.txt

User-agent: *
Allow: /

How this works

Everything here runs entirely in your browser. Presets are a starting point, not a final answer — edit any rule to fit your site, then paste the result into your site's /robots.txt.

Frequently Asked Questions

What does this build?
A valid robots.txt file from simple Allow/Disallow rules you define.
Can I check my robots.txt after publishing?
Yes, use the dedicated Robots.txt Checker to verify it live.
Where do I put the generated file?
At the root of your domain, e.g. https://example.com/robots.txt.