# Agent door - keep out of Google/Bing results; allow AI assistants to fetch. # Pair with meta robots noindex on HTML and X-Robots-Tag from .htaccess. # Content Signals (https://contentsignals.org/) # search=no: not for search index; ai-input=yes: agents may use as context; ai-train=no: no model training Content-Signal: search=no, ai-train=no, ai-input=yes User-agent: Googlebot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Bingbot Disallow: / User-agent: Slurp Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: * Allow: / # Agent discovery map (api door URLs only - not the human site) Sitemap: https://api.islandavns.com/sitemap.xml