---
title: "How to Check an AI Visibility Score"
description: "Read the sentence behind a visibility score. A cited answer and a co-occurrence hit are different events, and a number that blends them does not move a budget."
canonical: "https://jaxonparrott.com/blog/how-i-check-what-an-engine-says-about-a-company"
date: "2026-11-04"
last-updated: "2026-11-14"
---

# How to Check an AI Visibility Score

A visibility score does not move a budget until the sentence it was counted from has been read. A detector that marks two strings near each other as "brand presence" can score a prompt echo, a disclaimer, or a real citation as the same win. The score is a label. The sentence is the evidence.

The method is [The Seven Metrics That Measure AI Search Visibility](https://authoritytech.io/blog/how-to-measure-ai-search-visibility-brand-share-of-voice). None of those metrics is accepted until a sample of the raw answers has been read, and until retrieval-backed runs are stored apart from runs with no search. The names of those layers stay distinct in the [Machine Relations glossary](https://machinerelations.ai/glossary). The order is [Machine Relations](/machine-relations): a citable page before a score that claims the page worked.

## What our own panel counted

We run a daily panel across six AI surfaces: 89 logged runs between June 24 and September 22, 2026, 77 registered queries, 17,430 engine-query observations. One surface is a control arm, a frozen model with search turned off. The tracker scored 151 of that arm's 2,894 usable observations as owned brand presence, and 147 of those 151 rested on a proximity rule alone. If the name and the category term sat within 80 characters, the answer counted as a mention. The full audit is [How to Tell If Your AI Visibility Tool Is Counting False Brand Mentions](https://authoritytech.io/blog/ai-brand-mention-false-positives-audit-2026).

All 151 of the wins on that no-retrieval arm came from exactly two questions, both of which put the name and the category term in the prompt. The model was not being asked an open category question and volunteering a company. It was being handed the strings, and the detector was scoring the echo. A branded prompt measures something. It does not measure discovery. The other 75 queries on that arm produced zero no-retrieval wins. Same arm, same period, two kinds of question. One number is what a proximity rule did with a prompt that already contained the answer's nouns. The other is what it did when the prompt did not hand those nouns over.

A guard went in on 2026-09-11. The win rate on that arm fell from 6.0% (148 of 2,474 observations) to 0.7% (3 of 420). We read all three survivors. Each was an improvised description phrased one word outside the guard, so the error rate on what was left was 100%, on three wins. That is a string matcher being asked to do an entity detector's job. I had been reading the dashboard for 79 days before the sentences were read in bulk. The instrument was ours. The miss was ours. A patch that shrinks the numerator can look like quality. The rate on what survives is the number to ask for, and so is the equivalent of those 79 days: how long the score was live before anyone read the sentence. A tighter pattern is not a substitute for the sentence.

## The split the score had blended

Strip the detector and the remaining difference is whether the answer has a citation. Across five retrieval-enabled surfaces in the same panel, the identical detector rested only 0.4% of its wins on string proximity alone, against 97.4% on the arm with no citations. Perplexity, ChatGPT, and Gemini did not score a single win that way. The model did not become a different model between June and September. The product either fetched a page or it did not. A spreadsheet that averages those arms will report a company as "up" because the no-search arm echoed a branded prompt.

Anthropic's documentation is direct about a frozen model: a snapshot with a training cutoff, no live search, and no way to know what happened after that cutoff unless a tool call gives it one ([Anthropic](https://platform.claude.com/docs/en/models/overview)). Perplexity's help center says each claim in a retrieval-backed answer is expected to trace to a source it fetched ([Perplexity](https://www.perplexity.ai/help-center/en/articles/10352895-how-does-perplexity-work)). OpenAI's developer documentation draws the same line: a base model's knowledge is fixed at a training cutoff, and anything after that, or anything narrow in the training mix, depends on whether the product lets the model look it up ([OpenAI](https://help.openai.com/en/articles/8313359-how-chatgpt-and-our-foundation-models-are-developed)). Google's guidance on AI Overviews describes the other side of the same split: the system selects and cites web content at answer time, which is a different pipeline from anything stored in a model's weights ([Google](https://developers.google.com/search/docs/appearance/ai-features)). Those four documents describe the pipelines our methodology had blended. They are not our methodology.

I fund the pipeline that cites. A training snapshot updates on the vendor's schedule. A page on the open web can be retrieved the day someone asks.

## Four checks, then a sample

Ask whether the surface retrieves or recites. A retrieval-enabled answer cites a URL. A no-retrieval answer draws on a frozen snapshot. A report that blends them into one visibility score hides the split that changed our count from a proximity win to a read of the sentence.

Ask whether a "mention" requires a cited source, a checkable claim, or only two strings near each other. If it is the third, ask for the false-positive rate on the no-retrieval arm specifically. We did not know ours until we computed it. A vendor who cannot produce that rate has not run the test.

Ask what fraction of wins come from questions that already contain the brand name. All 151 of our no-retrieval wins came from 2 of 77 queries. A model completing a sentence it was handed is a different event from a model naming a company on an open question. Publish those rates in separate columns.

Read the answers. The only way to catch a proximity hit that does not support the claim is to read a sample of transcripts before the aggregate is allowed near a decision. After the 2026-09-11 guard, the three remaining wins still failed that read. I do not read every transcript. I read enough that a proximity rule cannot hide. On our panel the failure was concentrated. Every one of the 151 no-retrieval wins came from 2 of 77 queries. Stratify on purpose: some runs where the prompt already contains the name, some where it does not, some with a cited URL, some without. Sampling only the wins meets the echo. The echo is what the 80-character window was built to find.

Separate the seven metrics on the measurement page into ones that can be computed from a URL and ones that can be computed from a string. A metric that can be gamed by typing our name into the prompt does not belong in the same cell as a metric that requires a cited page. The panel can keep running daily. The budget moves on the second kind, after a read.

Branded queries stay in a recognition series. Open category queries, on retrieval-enabled surfaces, are the series for a budget. A co-occurrence match with no cited URL gets dropped. On the surface that does not cite, 97.4% of our scored mentions rested on two strings sitting near each other. I will not spend against a number with that composition.

This applies to any score that claims "presence," "mention," or "share of voice" across more than one engine, especially if the export does not attach the answer text and the citation URLs. The seven metrics are useful once each metric has a sentence under it. They are not useful as a blended index of proximity hits.

A detector, ours or a vendor's, earns a place in a plan when a fresh window posts a no-retrieval co-occurrence-only share near the 0.4% we saw on the retrieval-enabled surfaces, with the raw sentences available, and with branded prompts excluded from the discovery number. The three no-retrieval wins that survived the guard did not survive a read. All three were unanchored.

## FAQ

### What should be opened first when a dashboard says presence went up?

The answer text for a sample of the runs, plus the rule that created the point. On our panel the rule was an 80-character window. It marked 151 observations on a frozen, no-search surface, and all 151 came from two branded questions. A rise that lives entirely inside those questions is a change in the echo, not a change in discovery.

### Are a frozen model and a search-enabled answer the same kind of evidence?

They are different pipelines. Anthropic describes a frozen model as a snapshot with a cutoff and no live search unless a tool call provides it. Perplexity expects a retrieval-backed claim to trace to a fetched source. In our panel, proximity-only wins were 97.4% of the scored mentions on the arm with no citations and 0.4% on five retrieval-enabled surfaces. Store those arms in different columns.

### Did the September 11 guard fix the measurement?

It changed the count. The win rate fell from 6.0% to 0.7%. The three wins that remained failed a read and were the same class of error, phrased past the new patterns. The error rate on those three was 100%. A guard is a reason to reread. Branded queries are now out of every presence rate I publish.

### What gets ignored even if the number looks precise?

A single score that mixes engines, mixes branded and open prompts, and does not keep the sentence. The other 75 queries produced zero no-retrieval wins. That precision is about a detector on one arm. It is not a market rank.

---

*Published November 4, 2026 · First written September 2026*
By [Jaxon Parrott](https://jaxonparrott.com) — Founder & CEO, [AuthorityTech](https://authoritytech.io)
Updated 2026-11-14

Part of [Machine Relations](https://jaxonparrott.com/machine-relations) · [Glossary](https://machinerelations.ai/glossary) · [Founder judgment](https://jaxonparrott.com/topics/founder-judgment)


Tags: Machine Relations, AI Search, Measurement, Founder Judgment

## Continue reading

- [The Category Ownership Trap](https://jaxonparrott.com/blog/category-ownership-trap): Owning a category name leaves the buyer's question open. I coined Machine Relations in 2024, and the commercial question is still a separate job.
- [How I Hire an AI Visibility Vendor](https://jaxonparrott.com/blog/do-not-hire-ai-visibility-vendor-rank-alone): Hire an AI visibility vendor when you can see the sources behind the rank. In the buyer-choice segment, 399 of 699 cited domains appear in a single run.
- [How to Choose a PR Firm for AI Search](https://jaxonparrott.com/blog/how-i-choose-a-pr-firm): I choose a PR firm by citation movement on the buyer queries I need to own. Speed matters once the story is one an answer can cite.

---

*Machine-readable version of [https://jaxonparrott.com/blog/how-i-check-what-an-engine-says-about-a-company](https://jaxonparrott.com/blog/how-i-check-what-an-engine-says-about-a-company)*
