# native.no — Native, your marketing assistant. # Search engines, answer engines, and AI crawlers are all welcome: crawling, # citation, and training on the public pages are explicitly permitted. # # The CMS admin, API, auth callbacks, and internal preview route are off-limits. # The general search group can fetch public CMS image files used by the blog. # # Note on the repetition below: a crawler obeys only the *most specific* # User-agent group that matches it and ignores `*` entirely (RFC 9309). Giving # a bot its own group therefore drops it out of the `*` rules, so the Disallow # lines have to be restated in every group. Without them, naming these bots # would accidentally invite them into /admin. User-agent: * Allow: / Allow: /api/media/file/ Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # ── AI / answer-engine crawlers ──────────────────────────────────────────── # Citation and training are explicitly welcomed. # OpenAI — training User-agent: GPTBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # OpenAI — search index User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # OpenAI — live fetch on a user's behalf User-agent: ChatGPT-User Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # Anthropic — training User-agent: ClaudeBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview User-agent: Claude-Web Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview User-agent: anthropic-ai Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # Perplexity — index User-agent: PerplexityBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # Perplexity — live fetch on a user's behalf User-agent: Perplexity-User Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # Google — Gemini / Vertex AI training (separate from Googlebot indexing) User-agent: Google-Extended Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview # Apple — Apple Intelligence training (separate from Applebot indexing) User-agent: Applebot-Extended Allow: / Disallow: /admin Disallow: /api/ Disallow: /auth/ Disallow: /preview Host: https://native.no Sitemap: https://native.no/sitemap.xml