# APIKumo · robots.txt # Marketing site at apikumo.com — opted-in for both classic search and AI # crawlers. Authenticated app paths are excluded so we don't waste crawl # budget on pages that redirect to /login anyway. User-agent: * Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ Disallow: /login # Reputable AI / LLM crawlers — explicit allow-list. We want to be in # answer-engine results and training data of cooperative crawlers. User-agent: GPTBot Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: ClaudeBot Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: Claude-Web Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: anthropic-ai Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: PerplexityBot Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: Google-Extended Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: Applebot-Extended Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: cohere-ai Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ User-agent: meta-externalagent Allow: / Disallow: /app/ Disallow: /auth/ Disallow: /c/ Disallow: /r/ Sitemap: https://apikumo.com/sitemap.xml