How we measure whether AI search is actually working
AI search is new enough that a lot of people selling it lean on numbers that sound impressive and mean nothing. So before we talk about what we track, here is what we ignore. We do not care about your "AI visibility score" from some dashboard, we do not chase raw impressions, and we do not celebrate that ChatGPT can describe your business when prompted with your exact name and address — of course it can, you handed it the answer. Those are vanity metrics. They move up and to the right and change nothing about your phone ringing.
What we actually measure starts with the question no vanity dashboard answers: when a real Hopewell customer asks a buying question without naming you, do you come up? We run the prompts your customers run — "who's a reliable HVAC company in Hopewell VA," "best place for barbecue near Fort Gregg-Adams," "emergency electrician Prince George" — across ChatGPT, Google's AI Overviews, and Perplexity, and we log whether you are named, how you are described, and who is named instead of you. That is the scoreboard. We track it over time, so improvement is a before-and-after you can read, not a claim.
Second, we watch accuracy, because being mentioned wrong is its own problem. An AI that recommends you but lists the wrong hours, an old phone number, or a service you dropped is quietly sending customers to a dead end. Part of the job is making sure the facts these tools repeat about you are current and correct — and that is measurable too. We check it the same way a customer would.
Third, and the one that actually pays the bills: referral traffic and leads that trace back to AI tools. Google Analytics and Search Console now break out visits that arrive from AI Overviews and chat assistants, and we watch that channel grow — and more importantly, we watch whether those visitors call, book, or fill out a form. A visit that does nothing is not a win. A visit from a Fort Gregg-Adams newcomer who found you through ChatGPT and then dialed your number is the whole point.
- Are you named in un-branded buying questions across ChatGPT, AI Overviews, and Perplexity?
- Are the facts those tools repeat about you accurate and current?
- Is AI-referred traffic growing — and is it converting into calls and bookings?
None of these is instant, and we do not pretend otherwise. AI tools update their picture of your business over weeks, not hours, and the honest read is a trend across a couple of months. But every metric here ties to something real — a customer, a call, a booking — instead of a feel-good chart. If you want to see where your Hopewell business stands in AI answers today, that baseline check is the first thing an AI Search engagement produces.