Skip to main content
friendly4AI LogoMaking websites AI-friendly - Your website optimization platform for AI systemsfriendly4AI
  • Product
  • Leaderboard
  • Pricing
  • Blog
Sign in
  1. Methodology
  2. ›
  3. Parameters
  4. ›
  5. AI Opt-Out Signals

AI Opt-Out Signals

stable

Category: crawlability · Methodology v4.5

friendly4AI flags an AI opt-out when any one of these signals shows up: - noai or noimageai in the X-Robots-Tag response header or the page's <meta name="robots"> tag.

Signal Source

Source
https://{domain}/robots.txt + meta robots + X-Robots-Tag
Kind
http_response

Score Bands

VerdictCondition
Passno AI opt-out directive detected — no noai/noimageai in meta robots or X-Robots-Tag, fewer than five tracked AI crawlers blocked in robots.txt, and no wildcard Disallow: / (informational result; AI access is open)
Partialno partial tier — this is a binary, informational signal; the borderline is whether any opt-out condition is met (noai/noimageai present, five or more tracked AI crawlers blocked, or a wildcard Disallow: /), which flips the result from no-opt-out to opt-out-detected
Failan AI opt-out directive is detected — noai or noimageai in meta robots or X-Robots-Tag, OR five or more tracked AI crawlers blocked via robots.txt Disallow: /, OR a wildcard Disallow: / for User-agent: *

Description

AI Opt-Out Signals is an informational check that detects whether your site explicitly tells AI systems to stay away. friendly4AI looks in three places for an opt-out directive: the X-Robots-Tag response header and the <meta name="robots"> tag for noai or noimageai, plus robots.txt for site-wide AI exclusion. The result is binary — opt-out detected or not — and it does not affect your AI-Readiness Score.

What does this parameter check?

friendly4AI flags an AI opt-out when any one of these signals shows up:

  • noai or noimageai in the X-Robots-Tag response header or the page's <meta name="robots"> tag.
  • Five or more tracked AI crawlers blocked by Disallow: / in robots.txt — bots such as GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot, and Bytespider.
  • A wildcard Disallow: / under User-agent: *, which blocks every crawler.

Why does it matter for AI-readiness?

This parameter is informational and stays out of the AI-Readiness Score — it reports a signal but never raises or lowers your number. Opting out of AI usage is a legitimate business choice, and media, legal, and enterprise sites make it all the time. So friendly4AI surfaces the signal instead of penalizing it.

What this check really tells you is intent. When a site deliberately carries noai or blocks the major AI crawlers, a low Crawlability result is the policy working, not a misconfiguration to chase down. Read this parameter next to the scored access checks to decide whether restricted AI access is on purpose.

How is it scored?

Under the v4.5 methodology this is a binary, informational check that does not contribute to the numeric score:

  • No opt-out detected (pass): none of the three conditions above holds — AI access is open.
  • Opt-out detected (fail): at least one condition holds — noai/noimageai is present, five or more tracked AI crawlers are blocked by Disallow: /, or a wildcard Disallow: / blocks User-agent: *.

There is no partial tier. The only question is whether at least one opt-out condition is met, and that single answer flips the result from no-opt-out to opt-out-detected. Since the parameter sits outside scoring, neither outcome moves your AI-Readiness Score.

How do you fix common issues?

  • If a low access score surprises you, look for a stray noai or noimageai in your X-Robots-Tag header or meta robots tag and remove it when you want AI access.
  • Check robots.txt for a wildcard Disallow: /, or for per-bot Disallow: / rules spread across many AI crawlers. Both trip the opt-out signal.
  • When the opt-out is intentional, leave it alone. This parameter confirms your restrictions are working as designed.
  • Pair this signal with AI Crawler Access Control and robots.txt Accessibility to see exactly which engines your policy reaches.
  • Re-scan after you edit headers or robots.txt to confirm the opt-out state matches what you intended.

Version History

Introduced
v4.0
Last changed
v4.5

Key takeaways

  • Signal: https://{domain}/robots.txt + meta robots + X-Robots-Tag
  • Category: Crawlability & Access
  • Passes when: no AI opt-out directive detected — no noai/noimageai in meta robots or X-Robo…

Related Parameters

  • AI Crawler Access Control
  • robots.txt Accessibility
  • AI Usage Policy

View full methodology changelog · All parameters · GEO/AEO glossary

Suggest a change to this parameter


friendly4AI LogoMaking websites AI-friendly - Your website optimization platform for AI systemsfriendly4AI

The starting point for making your website AI-friendly.

ai@friendly4.ai
ProductsGEO ScannerAI VisibilityMethodologyDemoLeaderboardHow we comparePricing
friendly4AIAbout usBlogFor developersQuickstartAPI referenceContact usFAQsGlossary
LegalTerms and ConditionsPrivacy PolicyAI usage policy
friendly4AI © 2026