QBiz Leads AI

How 20 Identical Queries Expose AI Search's Hidden Sources and Blind Spots

We ran the same 20 local-professional searches on ChatGPT and Google AI Mode. When customers ask for a dentist, plumber, lawyer, or accountant, which businesses do these engines recommend? Which ones do they read about but never surface? And how much do they actually agree?

The answers reveal structural differences in how AI engines surface and cite information — with direct implications for any business trying to show up in AI search.

What We Tested

We searched for local professionals in Austin, Texas across four categories, five prompts per vertical:

Dentists (5 queries) — emergency care, walk-in availability, implants, family-friendly, weekend hours Plumbers (5 queries) — emergency 24-hour service, water heater repair, burst pipes, drain cleaning, licensed providers Lawyers (5 queries) — family law, personal injury, divorce, free consultations, small business Accountants (5 queries) — tax, bookkeeping, business accounting [not detailed here; see full methodology log]

For each search, we ran the EXACT SAME prompt on both platforms: - ChatGPT (web version; geolocation was NOT overridden and remained set to the operator's UK location) - Google AI Mode (browser geolocation manually set to downtown Austin, TX)

Note: Google showed AI Overviews automatically in 6 of 20 queries (30%). The other 14 required manually switching to the separate "AI Mode" tab. This distinction between automatic AI Overview and manually-selected AI Mode is significant for visibility.

We captured every business named, every source cited in visible source panels, and observable recommendation decisions.

Screenshots from the 20 queries:

Google search showing organic results without AI Overview for emergency dentist query
Google's default "All" results tab for "best emergency dentist in Austin Texas" — no AI Overview auto-triggered. Manual switch to AI Mode was required for an AI-generated answer.
Google AI Mode interface showing AI Overview answer with business recommendations
Google's AI Mode tab (manual selection required) showing the AI-generated response with business recommendations, sources panel, and interactive follow-up questions.

The Headline Finding: These Engines Pull From Different Sources

For subjective "best X" queries, the two engines recommended almost entirely different businesses. For objective factual queries, they converged more.

Google AI Mode required manual selection for 14 of 20 queries. Only 6 searches auto-triggered a standard AI Overview on Google's default results tab; the other 14 needed users to manually click into the separate "AI Mode" tab. This is a practical finding: if your business isn't appearing in the automatic AI Overview on Google's default results, many customers won't discover that an AI-powered answer exists.

ChatGPT response to 'best emergency dentist in Austin Texas' query showing map interface and business cards
ChatGPT's interactive map + business cards interface for local professional queries. Both engines render structured business recommendations rather than simple text lists.

For subjective queries vs. factual queries: - Subjective "best X" queries showed low overlap. When both engines answered the same subjective question ("best family dentist," "best plumber for water heater repair"), they recommended almost entirely different businesses. Across the subjective prompts, we saw only 1-2 shared business names out of 9-13 recommendations combined per query. - Factual queries showed higher overlap. For the objectively verifiable "dentist open on weekends" query, 4 of Google's 5 recommendations also appeared in ChatGPT's 7-name list — the highest observed overlap rate in this 20-query sample (4/5 Google and 4/7 ChatGPT).

What this suggests: The engines drew from different sources for subjective queries but converged for objective, factual queries in this sample.


Where Google Cites Sources: A Structural Problem

Google's AI Mode cited businesses from locations that had nothing to do with the Austin query:

Out-of-State & Out-of-Area Citations

Google's AI Mode cited sources from locations that had nothing to do with Austin:

Confirmed examples from this 20-query sample: - A Pennsylvania HVAC company's page cited to support an Austin water-heater recommendation - A Brownsville, TX plumbing company (280 miles away) displayed as a recommendation for an Austin emergency plumber query - Supporting sources for plumbing advice drawn from Florida, California, Missouri, Arizona, and New York - A Gibsonia, Pennsylvania business page cited 5 separate times to support local Austin business recommendations in a single answer

Most serious case: For the "plumber in Austin Texas for burst pipe" query, Google recommended Lone Star Plumbing with its location listed as Slaton, TX (320 miles away, in the Lubbock area). A customer in an active emergency could follow this recommendation to a business in a different region entirely.

Google AI Mode showing Lone Star Plumbing recommendation with Slaton TX location displayed
Google AI Mode recommended "Lone Star Plumbing" for an Austin burst-pipe emergency, but displayed its location as Slaton, TX (320 miles away in the Lubbock area). A customer in an emergency could be directed hundreds of miles from their location.
Google sources panel showing Pennsylvania, California, and other out-of-state citations
The sources panel for a water-heater repair query reveals confirmed citations from Gibsonia PA, Riverside CA, Fenton MO, Peoria AZ, and New York City — none in the Austin area — cited to support local Austin plumbing recommendations.

Category Mismatches

Google's own business-profile cards sometimes contradicted the AI recommendation: - ABC Home & Commercial: Google's AI Mode recommended this business for plumbing work in the "emergency plumber" query, but Google's own business-profile category label showed "Pest control service." (The underlying business does offer plumbing services, but the category mismatch is visible directly in Google's UI.) - Goettl Air Conditioning: Recommended for an Austin plumbing emergency at a 512 area code number, but its map card displayed "Las Vegas, NV" as the primary listed location

Google business card for ABC Home & Commercial showing category mismatch
Google's own business card for ABC Home & Commercial shows "Pest control service" as the category, yet the AI answer recommends it for plumbing work. The underlying business does offer plumbing, but the category mismatch is visible directly in Google's UI.
Goettl Air Conditioning map card showing Las Vegas NV location
Goettl Air Conditioning's map card explicitly displays "Las Vegas, NV" as the primary location, yet it's recommended for an Austin plumbing emergency at a 512 area code number.

Paid/Sponsored Sources

Google cited "sponsored selectee" listings from Super Lawyers and other paid directories. ChatGPT explicitly flagged these as "= Sponsored super lawyers selectees" in its sources — but both engines still read and considered them.


Source Quality Issues in Both Engines

Both engines cited sources with freshness and attribution problems:

Reddit: Aged Sources (Both Engines)

Both engines cited Reddit threads to support local-service recommendations, but with a freshness problem. The oldest Reddit citation found across both engines was August 2021 — nearly 5 years old at the time of this study. For queries about "best plumber" or "good family dentist," both ChatGPT and Google pulled from Reddit discussions spanning years old (August 2021) to recent (July 2026), without visible weighting for recency.

ChatGPT sources showing Reddit threads from 2021-2024
ChatGPT's sources for plumbing and dentist queries repeatedly cite Reddit discussions from August 2021 (nearly 5 years old), June 2025, and other dates spanning years. No weighting for source recency is visible.

Lead-Gen and Directory Sites

For competitive "best X" queries, ChatGPT's sources were dominated by third-party ranking aggregators (Expertise.com, HomeAdvisor, Angi's List, SiftPros) rather than businesses' own sites. Some of these featured lead-gen hallmarks:

Staging/Development Sites

For a divorce lawyer query, ChatGPT explicitly cited "Batrice Law Firm Staging" — a pre-production staging/development environment, not the live business website — as a source to support the business's qualifications in its recommendation.

ChatGPT sources showing Batrice Law Firm Staging
ChatGPT's sources panel explicitly labels one cited source "Batrice Law Firm **Staging**" — a pre-production/development environment, not the live business website — cited as evidence for a divorce lawyer recommendation.

Self-Inflating Claims in Sources

Businesses in both engines' sources displayed large, specific dollar figures ("$300M+ recovered," "$400M+ won," specific settlement amounts) in their own listings and directory entries. Both engines read these sources but notably did NOT promote the businesses with the highest claims into their top recommendations — a possible indicator that both engines may weight inflated claims with caution, though the sample size is too small to confirm intent.


The "Read But Never Named" Gap

Both engines have a consistent pattern: they read far more sources than they name as recommendations.

Confirmed examples from this sample: - ChatGPT on "licensed plumber in Austin": Cited 15 total sources; named 5 businesses in the recommendation. Of the 14 unnamed sources, one was an individual attorney with an out-of-state (Florida) trade license — a potential licensing-verification gap hidden in the background sourcing. - ChatGPT on "drain clog": Cited 16 total sources; named 5 businesses. The unnamed 11 included 4 businesses with specific recovery-dollar claims, national lifestyle-media DIY articles (Southern Living, Tom's Guide), and Reddit threads as old as August 2021. - Google AI Mode on "small business lawyer in Austin": Cited 24 total sources; named only 6 businesses. Of the 18 unnamed sources, 9 were competing law firms' own pages cited to support different firms' recommendations.

What this means: If your business isn't in an engine's top recommendations, you may still be influencing the answer through background research. Your pages are being read, even if not surfaced to the user.


Citation Attribution Problems

Cross-Company Citations

Google's AI Mode cited competitors' website pages as supporting evidence for a business's own claims. For divorce lawyers, six different competing law firms' own pages were cited to support a SINGLE firm's recommendation — turning a competitor's marketing copy into evidence for another firm's credibility. This is structurally unusual and worth noting: AI engines are treating generic corroborating-topic content (e.g., "how to handle uncontested divorce") as equivalent to third-party validation, even when it's from a direct competitor.

Google AI Mode sources showing competing law firms cited to support one firm's recommendation
For a divorce lawyer query, Google's sources panel shows six competing law firms' pages cited as supporting evidence for "Collin T. White Law Firm" — their marketing copy treated as validation of the AI's recommendation.

"Quoted" Claims That Don't Actually Quote Anything

Domain-Based Trust Signals

An "americanbarassociations.org" domain (plural "associations") was cited by ChatGPT. The domain name resembles the real American Bar Association (americanbar.org), but is not affiliated with the actual ABA. This is the sample's clearest example of a domain name that mimics a trusted institution.

ChatGPT sources showing americanbarassociations.org domain
ChatGPT's sources panel shows "americanbarassociations.org" (plural) cited as a source for free divorce lawyers. The domain name resembles the real American Bar Association's domain (americanbar.org), though it is not affiliated with the ABA.

Highest Overlap Observed: The Weekend-Hours Query

In this sample, one query produced notably higher agreement between engines than others.

The "dentist open on weekends" query: - ChatGPT named 7 businesses - Google named 5 businesses - 4 of Google's 5 also appeared in ChatGPT's 7-name list - Overlap rate: 4/5 Google and 4/7 ChatGPT

Subjective queries like "best family dentist" or "which lawyer is best for complex divorce" showed only 1–2 shared names out of 9–13 combined.

ChatGPT and Google both recommending overlapping dentists for weekend-hours query
For the "dentist open on weekends" query, four of Google's five named businesses also appeared in ChatGPT's seven-name list. This was the highest overlap rate observed in this 20-query sample.

How AI Engines Actually Choose What to Recommend

Subjective Queries = Structured Recommendations

For questions asking "best X" or "who's good with kids," both engines independently chose to tier their recommendations: - ChatGPT: Created decision matrices ("best for X situation → recommend Y firm") - Google: Organized answers into color-coded map categories and 3-tier groupings

Both engines also self-acknowledged uncertainty. Google opened one "best lawyer" answer with: "Finding the 'best' family lawyer depends on your specific needs..." — then immediately gave specific ranked recommendations, a framing that says "this is subjective" while simultaneously presenting an ordered list.

ChatGPT's decision matrix for family lawyer recommendations
ChatGPT's "Which lawyer is best for your situation?" decision matrix routes different circumstances to specific recommended firms — independently structured like Google's tiered approach for the same "best lawyer" query type.
Google's color-coded map categories for family lawyers
Google's map for the same "best lawyer" query uses color-coded pins by category (purple for "High-Asset & Complex Cases," red for "Compassionate Litigation & Custody," orange for "Full-Service & Trial Advocacy") — a parallel structuring to ChatGPT's decision matrix.

"Expertise" Rankings Vary Per Source

When ChatGPT read competing "best plumber" rankings from multiple sources (SiftPros, Expertise.com, HomeAdvisor), each named a different #1. ChatGPT's own final recommendation matched NONE of the three sources' #1 picks — it synthesized across them rather than adopting any single ranking wholesale.

Negative Information Is Sometimes Softened

When a Reddit thread's source snippet explicitly stated "whatever you do, don't call Radiant Plumbing," Google's AI Mode still recommended Radiant Plumbing as a top-5 pick, softening the warning to "some community members advise shopping around for minor repairs." The negative source was visible in Google's own expanded sources panel for anyone who dug into the details, but the main answer text downplayed it.

Google sources panel showing negative Reddit warning about Radiant Plumbing
Google's sources panel displays a Reddit thread preview with the exact text "Whatever you do, don't call Radian[t]..." yet the main answer text softens this to "some community members advise shopping around." The negative warning is visible to users who expand the sources, but downplayed in the visible answer.

What Successful AI-Visible Businesses Share

Across all 20 prompts, certain businesses appeared repeatedly:

Roto-Rooter appearing as top recommendation across multiple plumbing queries
Roto-Rooter appears consistently across ChatGPT's plumbing queries (emergency service, water heater repair, drain cleaning), the single most-repeated business recommendation in the entire study across both engines and all verticals.

Shared characteristics among these repeatedly-recommended businesses (in this sample): 1. Appeared on multiple directories (Google Business Profile, Yelp, Avvo, Expertise.com) 2. Displayed credentials, ratings, and reviews on their sites and directories 3. Had service-specific pages matching searched queries ("emergency plumber," "walk-in dentist," "divorce lawyer free consultation") 4. Were mentioned in local news or appeared in sources the engines cited 5. Stated hours, services, and availability clearly on their own sites


What This Sample Suggests

Based on 20 prompts across 2 engines and 4 verticals:

1. Be Indexed and Crawlable

Recommended businesses in this sample had indexed, navigable web content. We did not test blocked or outdated sites.

2. Build Credentials and Third-Party Validation

Businesses appearing repeatedly in recommendations across both engines displayed: - Author/professional bio with stated credentials - Third-party mentions (awards, professional recognitions, local media) - Years in business visible on their website - Specific, documented case results or portfolio examples

We cannot confirm from this sample whether these factors caused the recommendations or coincided with them.

3. Directory Presence

Recommended businesses in this sample appeared on multiple directories — Google Business Profile, Yelp, Avvo, Expertise.com, SuperLawyers, or industry-specific listings. We did not systematically compare recommended businesses against equivalently-credentialled businesses with fewer directory listings.

4. Service-Specific Content

Businesses with explicit service-specific pages ("emergency plumbing available 24/7," "walk-in dentist available Saturdays," "free divorce consultations") appeared in this sample's recommendations. We did not compare identical businesses with and without service-specific pages.

5. Specific, Verifiable Facts vs. Superlatives

Claims like "#1 plumber" or "recovered $100M" appeared in sources both engines read. Specific, verifiable facts ("available 24/7 with same-day service," "board certified since 2004," "flat-fee consultations starting at $X") were displayed by recommended businesses in this sample.

6. Local Media Mentions

Businesses mentioned in local news (Austin American-Statesman appeared in multiple answer sets) were present in recommendations. We did not compare recommended businesses against unmentioned businesses with equivalent credentials.


Critical Limitations of This Sample

Methodology constraints: - This is a 20-query spot-check, not a statistically representative sample of thousands of searches - Google AI Mode required manual selection for 14 of 20 queries; auto-trigger rates may differ by device, location, personalization setting, or date - Key asymmetry: ChatGPT's queries were run from the operator's UK location (device location not overridden), while Google's were set to Austin, TX. This geographic difference affects how location-dependent business recommendations appear; results are not fully equivalent - Both engines' citation behaviors, business rankings, and source weighting change daily and may differ by user account, geography, and search timing - The specific sources, directory versions, and business pages cited in this July 2026 sample may no longer appear identically

Run your own tests: Search for your own professional category in your own location on both platforms. Check which businesses appear, what sources they cite, and whether you're visible at all — even if not named in the recommendation, you may be influencing the answer through background research.


What We Observed

Both AI engines read far more sources than they surface in recommendations. Both cited sources with geographic mismatches, freshness problems, and category inconsistencies. For subjective queries in this sample, they pulled from different sources and recommended different businesses. For factual queries, they converged more.

Patterns observed in this 20-query sample: 1. Recommended businesses appeared on multiple directories (Google Business Profile, Yelp, Avvo, Expertise.com, industry-specific listings). 2. Recommended businesses displayed credentials, awards, and third-party validation on their own sites. 3. Businesses with explicit service-specific pages ("open Saturdays," "flat-fee consultations," "24-hour emergency service") appeared in recommendations. 4. Claims like "#1 plumber" or "$100M recovered" appeared in sources both engines read. 5. Businesses mentioned in local news appeared in recommendation sets.

Both engines expose their sources in visible citations and source panels. You can see which sources each engine cited. Audit where you're appearing, check your directory presence, and ensure your own website contains specific, verifiable details about your services and availability.


This research analyzed 20 identical queries across ChatGPT (web version, UK geolocation) and Google AI Mode (Austin, TX geolocation), with detailed source attribution and citation logging. All findings are based on direct observation of what sources each engine cited in its visible sources panel and what it recommended. Specific quotes and citations are preserved exactly as they appeared in each engine's answer and sources panel. This is a 20-query sample, not a statistically representative survey. The geographic asymmetry (UK for ChatGPT, Austin for Google) affects location-dependent recommendations and means results are not fully equivalent.

Get your AI Visibility audit →

Leave a comment

Thoughts on this post? Leave a comment below. Comments are moderated before they appear, so yours will not show on the page straight away.

Your email is used only to contact you about your comment if needed — it is never published.

Comments

No comments yet. Be the first to leave one above.