How we measure whether AI Search is actually working
AI search — the answers people get from ChatGPT, Google's AI Overviews, Perplexity and the like — is new enough that a lot of the "metrics" floating around are noise. Before you spend a dime chasing it, you should know what we actually watch and, just as important, what we deliberately ignore.
The metric that matters most is straightforward: does the AI name you when someone asks it a real buying question? We run the actual prompts a Petersburg customer would type — "who does emergency plumbing near Petersburg VA," "best HVAC company in the Tri-Cities," "kitchen remodeler Colonial Heights" — and we track whether your business shows up in the answer, whether it is cited as a source, and whether the details the AI repeats about you are correct. Being mentioned but with the wrong phone number or a competitor's service area is a problem we can only catch by checking the actual output, not a dashboard.
The second thing we measure is referral traffic and leads that trace back to AI tools. When someone reads an AI answer that recommends you and then clicks through or calls, that shows up in your analytics and your phone log if you are tracking properly. It is a smaller stream than traditional search today, but it is high-intent — people asking an AI for a recommendation are usually close to hiring — and it is growing fast enough to be worth watching now rather than later.
Here is what we ignore, because these are the vanity metrics that make reports look impressive and mean almost nothing:
- "AI visibility scores" from tools that invent a number with no defined methodology
- Raw mention counts that don't distinguish a real buying question from a trivia query
- Being cited on prompts no actual customer in Central Virginia would ever type
- Impressions or "reach" figures no one can tie to a lead or a phone call
The reason we are this strict is that AI answers pull from your existing web presence — your site content, your Google Business Profile, your reviews, and how clearly your pages state what you do and where. So the honest measure of success is not a vanity score; it is whether the machine's recommendation actually sends you work. If the AI starts naming you for the searches that matter in Petersburg and the surrounding Tri-Cities, and if a few of those turn into calls, it is working. If a tool shows your "score" going up but your phone is silent, it is not, no matter how green the chart looks. We report the version that ties to revenue, because that is the only version worth paying for.