# Search engines User-agent: Googlebot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Bingbot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Slurp Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: DuckDuckBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Baiduspider Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: YandexBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* # AI / LLM crawlers User-agent: GPTBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: ChatGPT-User Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: OAI-SearchBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: ClaudeBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Claude-User Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Claude-SearchBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: anthropic-ai Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Google-Extended Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: PerplexityBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Perplexity-User Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: CCBot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Meta-ExternalAgent Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Meta-ExternalFetcher Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Bytespider Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Applebot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Applebot-Extended Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: cohere-ai Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Diffbot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* User-agent: Amazonbot Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* # Catch-all for everything else User-agent: * Disallow: /en/parent Disallow: /en/join Disallow: /en/login Allow: /en/ Allow: /en Allow: /en/blogs Allow: /en/blogs/* Sitemap: https://www.zoodleapp.com/en/sitemap.xml