How we measure whether AI search is actually working
The problem with AI search is that it's hard to see. When ChatGPT recommends a Midlothian deck builder or Google's AI answer names a roofer near Route 288, there's no rank tracker with a tidy number and no click in your analytics that says "this came from an AI." So the temptation is to either declare victory on faith or chase metrics that feel measurable but mean nothing. We do neither. Here's what we actually watch, and what we deliberately ignore.
The core measurement is direct and unglamorous: we run the real questions your Midlothian customers ask, across the tools they use, and record whether you show up. "Who's the best HVAC company in Midlothian VA?" "Recommend a plumber near Brandermill." "Who does kitchen remodels in Chesterfield County?" We test these in ChatGPT, in Google's AI overviews, and in Perplexity, then track the answers over time — are you named at all, are you named first, and is what the AI says about you accurate. When a category shifts from "you're never mentioned" to "you're one of two names it gives," that's the metric that matters, and we can show it to you as a before-and-after you can read.
We also watch the inputs that drive those mentions, because they're the leading indicators. Is your site actually being crawled by the AI bots. Is your business information structured clearly enough that a model can quote it without guessing. Are the third-party sources these tools lean on — your profile, directories, review sites — saying consistent things about you. When those improve, the mentions follow, usually within a few weeks, so tracking them tells us the work is landing before the answers catch up.
Then there's the ground truth that beats every dashboard: what new customers say when they call. "I asked ChatGPT and it mentioned you" is now a real sentence Midlothian businesses hear, and we make sure your intake actually captures it. One honest answer to "how'd you find us" is worth more than a page of speculative attribution.
What we ignore is just as important. We don't report an "AI visibility score" from some tool that invented its own scale — those numbers are unaudited and easy to game. We don't count how many times your name appears in AI answers to questions nobody in Midlothian is actually asking. And we don't celebrate being mentioned in a generic "here's how to choose a contractor" response that names no one specifically — that's not a recommendation, it's filler. The whole point of AI search is being the specific business a real buyer near the Village of Midlothian gets pointed to at the moment they're deciding. If a metric doesn't connect to that, it's noise, and we leave it out of your report. Send Alex your business and the questions your customers ask, and we'll show you exactly where you stand today.