# Search engines — full access except private app routes User-agent: Googlebot User-agent: Googlebot-Image User-agent: Bingbot User-agent: Applebot Allow: / Disallow: /accounts/ Disallow: /dashboard/ Disallow: /business/ Disallow: /messages/ Disallow: /payments/ Disallow: /admin/ Disallow: /healthz # Social preview / link-unfurl bots User-agent: facebookexternalhit User-agent: Twitterbot User-agent: LinkedInBot User-agent: WhatsApp User-agent: TelegramBot User-agent: Slackbot Allow: / Disallow: /accounts/ Disallow: /dashboard/ Disallow: /business/ Disallow: /messages/ Disallow: /payments/ Disallow: /admin/ Disallow: /healthz # AI answer / citation engines — allowed (GEO matters for this product) User-agent: PerplexityBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot Allow: / Disallow: /accounts/ Disallow: /dashboard/ Disallow: /business/ Disallow: /messages/ Disallow: /payments/ Disallow: /admin/ Disallow: /healthz # AI training scrapers — blocked (not search/citation bots) User-agent: GPTBot User-agent: CCBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: Amazonbot User-agent: FacebookBot User-agent: Diffbot Disallow: / # Default — same private-route policy as search engines User-agent: * Allow: / Disallow: /accounts/ Disallow: /dashboard/ Disallow: /business/ Disallow: /messages/ Disallow: /payments/ Disallow: /admin/ Disallow: /healthz Sitemap: https://hirevana.ae/sitemap.xml Sitemap: https://hirevana.ae/jobs/sitemap.xml