# robots.txt for https://roledawn.com # Policy: public pages are open to search engines and AI answer engines. # Private app areas are closed to every crawler. User-agent: * Allow: / Disallow: /app Disallow: /auth Disallow: /admin Disallow: /login Disallow: /logout Disallow: /search Disallow: /webhooks Disallow: /api/v1/ # AI search / answer engines (explicitly allowed so a future blanket rule # or a CDN "block AI bots" toggle cannot silently remove us) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Google-Extended User-agent: Applebot User-agent: Applebot-Extended User-agent: Bingbot User-agent: DuckAssistBot User-agent: MistralAI-User Allow: / Disallow: /app Disallow: /auth Disallow: /admin Disallow: /login Disallow: /logout Disallow: /search Disallow: /webhooks Disallow: /api/v1/ Sitemap: https://roledawn.com/sitemap.xml