How We Measure Whether AI Search Is Actually Working in Portsmouth
AI search is new enough that a lot of agencies are selling it on vibes. When someone in Portsmouth asks ChatGPT, Google's AI Overviews, or Perplexity for a recommendation, we want your business to be the one that gets named — but wanting it is not measuring it. Here is how we actually tell whether the work is paying off, and just as importantly, which numbers we refuse to celebrate.
The first real metric is citation presence. We run the questions your Portsmouth customers actually ask — the equivalent of "who does emergency water damage repair near Olde Towne" or "best HVAC company in the 757" — through the major AI assistants on a recurring schedule, and we track whether your business gets mentioned, how it is described, and whether the AI links to your site as a source. That last part matters most: being named is good, being named as the cited source is the goal.
The second is accuracy of representation. AI tools sometimes describe a business with outdated hours, the wrong service area, or a service you stopped offering. We treat that as a problem to fix, not a win to report. If Portsmouth searchers are being told something wrong about you, a mention is actively hurting you.
The third is referral behavior we can see in the analytics — real visits arriving from AI assistants and AI-powered search features, and what those visitors do once they land. A person who arrives already half-convinced by an AI recommendation tends to convert differently than a cold click, and we watch for that pattern rather than raw volume.
Now the vanity metrics we ignore. We do not report "AI visibility scores" pulled from a black-box tool that cannot show its work. We do not celebrate being mentioned for a query no Portsmouth customer would ever type. And we do not count a mention in a generic national answer that has nothing to do with your service area — being listed among "top plumbers in the United States" does nothing for a business serving Churchland and Cradock.
- Tracked: citation presence and source links for real Portsmouth queries
- Tracked: whether AI describes your services and area correctly
- Tracked: actual referral traffic and behavior from AI tools
- Ignored: opaque "AI scores," off-target mentions, and national-only listings
The honest position is that AI search measurement is still maturing, and anyone claiming a precise, guaranteed ranking is guessing. What we can do is watch the metrics that connect to real customers, feed those findings back into your content and structured data, and adjust. This works hand in hand with your traditional SEO foundation, because the same clear, well-organized, genuinely helpful pages that rank in Google are the ones AI assistants trust enough to quote.