User-agent: * Disallow: /_next/static/ Disallow: /_next/image/ Allow: / Sitemap: https://zithara.ai/sitemap.xml Sitemap: https://blog.zithara.com/sitemap.xml # Allow Large Language Model Crawlers User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: /