User-agent: * # ============================================================================== # 1. STRICT DISALLOWS — Completely blocked for ALL humans, bots, and AI agents # ============================================================================== Disallow: /access/ Disallow: /admin/ Disallow: /api/checkout/ Disallow: /api/gate-1991/ Disallow: /api/partners/ Disallow: /api/portal/ Disallow: /api/staging-studio/ Disallow: /api/submit-contact/ Disallow: /api/support/ Disallow: /api/vendor/ Disallow: /checkout/ Disallow: /gate-1991/ Disallow: /portal/ Disallow: /tmp/ # ============================================================================== # 2. SELECTIVE ALLOWS — Visual stylesheets, public APIs, and discovery manifests # ============================================================================== Allow: /assets/css/ Allow: /assets/js/ Allow: /assets/images/ Allow: /assets/fonts/ Allow: /api/pricing.json Allow: /api/agent-spec.json Allow: /api/a2a/ Allow: /api/x402/ Allow: /openapi.json Allow: /auth.md Allow: /acp.json Allow: /ucp.json Allow: /.well-known/ # ============================================================================== # 2b. NAMED AI INDEXER ALLOWS (explicit; wildcard above already covers) # ============================================================================== User-agent: ExaBot Allow: / User-agent: ClaudeBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ChatGPT-User Allow: / # ============================================================================== # 3. SITEMAP + MACHINE MANIFESTS # ============================================================================== # The one valid XML sitemap — parsed by Google/GSC. Sitemap: https://aradia.com/sitemap.xml # Machine discovery manifests (advertised for agents; NOT sitemaps): Manifest: https://aradia.com/llms.txt Manifest: https://aradia.com/llms-full.txt Manifest: https://aradia.com/.well-known/mcp.json Manifest: https://aradia.com/.well-known/agent-card.json # ============================================================================== # 4. CLOUDFLARE CONTENT-SIGNAL POLICY # ============================================================================== Content-Signal: search=yes, ai-input=yes, ai-train=no Agentmap: https://aradia.com/.well-known/ai-catalog.json