Anything a client cannot argue with is not a report. If you cannot open the document, disagree with a conclusion and point at the evidence that contradicts it, you have been sent a reassurance rather than an analysis.
Log the conditions with every run, including which assistant, which mode, whether web access was enabled and the date. When a result moves sharply, the conditions log is usually what tells you whether the world changed or your setup did.
Build the run into an existing routine rather than creating a new one. Measurement programmes in this field fail through quiet abandonment rather than through a decision, and a modest set attached to an established monthly process survives far longer than an ambitious one that depends on somebody remembering to start it.
The Baseline Is Worth More the Earlier You Take It A baseline taken today lets you attribute change later. Without one, when something moves you will be reduced to guessing whether it was the assistants, a search update, a competitor's campaign, seasonality or your own site changes.
Results Split by Intent, With Run Counts Not one number. Mention rate reported as a fraction with the run count visible, broken out by prompt tier, so buying intent is never blended with definitional questions.
And in a fast moving category where competitors are actively publishing, monthly can miss a shift. Even then, keep the full set monthly and run a small subset more frequently rather than expanding everything.
One reframing helps when presenting this internally. Report the channel as influence rather than acquisition. Acquisition framing invites a comparison against paid media on cost per lead, which this channel will lose on the reported numbers even where it is working, because most of its effect never appears as a referral. Influence framing invites the right question, which is whether more of your market arrives already knowing who you are.
The problem is not that the tools are dishonest. It is that the vendor controls both the number and the prompt set that produces it, so the score can improve without anything happening to your business, and a client has no way to audit the difference.
Testing too rarely means you find out about a problem a quarter after it started. Testing too often means drowning in variance that looks like signal and reacting to noise. Both failures are common and the second is more expensive, because it produces work.
A useful way to think about the sequence is that each stage moved a task from the user to the interface. First the fact, then the summary, and now the comparison. Each move removed a reason to visit a website, and each was followed by an industry insisting the change had been overstated. It is reasonable to expect the pattern to continue rather than to stop at a convenient point.
Connect It to Something in the Business Referral traffic from assistant domains should be segmented in analytics and tracked, with the understanding that it undercounts. Some assistants strip referrer data and some visits arrive looking direct.
Search marketing has a long history of reporting numbers that rise while the business does not. Impressions, rankings for terms nobody buys on, traffic to pages with no commercial intent. The new channel has arrived with its own version of this, and the version is worse, because there is no independent console to check the claims against.
A reasonable definition: after two quarters, no increase in mentions on buying intent prompts, no improvement in the accuracy of how you are described, and no new citations from the sources your category's answers are built on. If all three are flat, the work is not landing.
Why One Snapshot Proves Almost Nothing Generation involves randomness, and retrieval can return different pages between runs. The same prompt asked twice in a row can produce different companies in different orders.
A retainer describing ongoing optimisation and strategic guidance with no countable deliverable is a subscription to a relationship. It may still be worth having, and you should know that is what you bought.
One scheduling detail improves comparability more than it should. Run on roughly the same date each month rather than whenever somebody remembers. Retrieval behaviour and the freshness of competing sources both vary over a month, and a series taken at irregular intervals introduces variation that looks like a trend.
What to Spend Where If the budget is small, buy the audit and do the listings work yourself. Correcting your presence on the sources that already get cited is the highest return activity available and it requires attention rather than expertise.
This is the whole argument in one sentence, llm seo and it is why the audit is worth running even if you intend to do nothing with the findings for six months. The measurement is cheap. Reconstructing a baseline you never took is impossible.
What Honest Reporting Contains The prompt set, versioned and unchanged since last month. The raw answers, kept in full rather than summarised. Which competitors were named. Which sources were cited. What work was done. What moved, and the specific claim about which work caused it.