How We Measure Whether AI Search Is Actually Working for You
AI search — the answers people now get straight from ChatGPT, Google's AI overviews, Perplexity, and the assistants baked into their phones — is genuinely new, which means a lot of people are measuring it with the wrong ruler. In a market like Wise, where the customer pool is small and every real lead matters, measuring the wrong thing is worse than not measuring at all. So it is worth being clear about what we actually watch and what we deliberately ignore.
What we care about is simple to say: does the AI mention you, and does it mention you correctly, when someone asks it a question your business should answer? If a customer near Norton or Big Stone Gap asks an assistant "who does this work in Wise County," the win is your name coming back with the right phone number and an accurate description of what you do. We track that by running the real questions your customers ask — not made-up ones — across the major AI tools on a schedule, and logging whether you show up, how you are described, and whether the facts are right. That last part is not optional. An AI that names you but lists a dead phone number or the wrong service area is a liability, and catching that is half the job.
We also watch the trail these tools leave behind. When an assistant cites a source, we look at whether it is pulling from your site, your Google Business Profile, or a stale third-party listing — because that tells us where to reinforce. And we watch the slow but real trickle of referral traffic and calls that trace back to an AI answer rather than a classic search. In a small market this trickle is not huge in raw numbers, but the intent is high: someone who got your name from a direct answer is often ready to act.
Now the vanity metrics we ignore. We do not chase "AI impressions" as a standalone trophy, because being mentioned in an answer nobody in your market is asking is worth nothing. We do not report generic "AI is growing" industry statistics as if they were your results — that is filler, not proof. We do not celebrate showing up for questions no Wise-area customer would ever type. And we do not confuse the AI knowing your industry exists with the AI recommending your specific business by name.
- We track: whether AI names you correctly for real customer questions, whether the facts are accurate, what sources it pulls from, and the leads that trace back
- We ignore: raw "AI impressions," borrowed industry stats, mentions for searches no local ever makes, and generic category awareness
The honest truth is that AI search measurement is still maturing, and anyone claiming a precise dashboard with tidy conversion attribution is overselling. What we can do — and what actually helps you — is run your real questions regularly, fix what the AI gets wrong about you, and make sure the information those tools feed on is clean and complete. Get that right and you are correctly represented in the place a growing share of Wise customers now go first.