How We Measure Whether AI Search Is Actually Working for You
AI search is new enough that a lot of agencies are selling it on vibes — "get found in ChatGPT" with no way to prove it. We don't work that way. If we're going to tell a Waynesboro business that showing up in AI answers matters, we have to be able to show you when it happens and be honest when it doesn't. Here's exactly what we track, and the metrics we deliberately ignore.
The measurement that matters most is presence and accuracy in the actual answers. We run the real questions your customers ask — "who does emergency HVAC in Waynesboro," "best deck builder near Afton Mountain," "is there a place in Waynesboro that does X" — through ChatGPT, Google's AI Overviews, Perplexity, and the others, on a schedule. Then we log whether you appear, whether the AI describes you correctly, and whether it sends people to your site or your phone. When a tool starts naming you where it used to name a competitor in Staunton or Charlottesville, that's a real, documented win we can point to.
We also watch the referral traffic these tools actually send. AI Overviews and Perplexity leave a trail in your analytics, and that trail is growing for local service searches. It's still smaller than classic Google traffic, so we don't oversell it — but the visitors who arrive from an AI answer tend to be far down the buying path, because the AI already did the comparison for them. A handful of those a month can be worth more than a flood of tire-kickers. We report the number and the quality, not just the number.
- Presence — do you appear in the AI answer for the questions that matter here
- Accuracy — does the AI describe your service, area, and details correctly
- Referral quality — do AI-sourced visitors actually call or fill out the form
- Citation strength — is the AI pulling from your site or from a third party
Now the vanity metrics we ignore. We don't report a made-up "AI visibility score" pulled from a black-box dashboard, because those numbers can't be tied to anything you can verify or a customer you can count. We don't count impressions in AI results the way some tools try to, because an impression nobody acted on didn't help your business in Waynesboro. And we're skeptical of any "we got you into 200 AI tools" claim — most of those tools nobody in the Shenandoah Valley is using to find a plumber.
The honest truth is that AI search is early, and for many local trades the volume is still modest. What we can promise is that we'll measure it against reality — your appearances, your traffic, your calls — and we'll tell you plainly whether it's earning its place in the plan or whether your budget is better spent on local SEO this quarter. When it's working, you'll see the receipts, not a feeling.