Robots.txt Generator

Create crawler directives and copy the generated file.

User-agent

Disallow rules

Allow rules

Sitemap URL (optional)

robots.txt

User-agent: *
Disallow: /admin
Disallow: /api

Save as /public/robots.txt or serve dynamically.