🤖 Robots.txt Tester

Paste robots.txt rules and test whether a URL path is allowed or blocked for a crawler user-agent.

Robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/

User-agent

URL or path to test