Short answer: You don’t have to pay the directories — but you do have to be mentioned. When someone asks ChatGPT “who should I call,” the pages it reads are mostly the ones that rank for that question, and those are usually “best of” listicles. Businesses that show up in the two or three listicles ranking on Bing for their trade and city get named. Businesses with no mentions anywhere get named in only 2.8% of relevant answers.
The numbers behind the listicles
This isn’t a hunch — it’s measured:
“Best of” list articles account for roughly 21% of all AI citations (arXiv 2606.20065).
Brands with no citations on their own site and no mentions elsewhere were named in only 2.8% of relevant ChatGPT answers — across a 34,960-prompt study (arXiv 2609.23162).
One agency’s check of ChatGPT answers found 95% pointed to a directory as the source.
A Bend, Oregon owner’s check this month put it in plain terms: the pages ChatGPT reads are “mostly the ones that rank for the query and the ones that list or compare providers.” A Bend plumber sitting in the two or three “best plumbers in Bend” lists that rank on Bing is far more likely to be named than one whose only mention is their own homepage.
Why this feels unfair (and partly is)
Contractors resent listicles and directories as pay-to-play machines, and they’re not wrong to be suspicious. The directories sell placement, sell leads, and sell ads against the very searches you want to win. Being told “the bot reads the listicle” can sound like being told to feed the beast.
But there’s a difference between paying the directories and being listed on them. Most “best of” pages have free listing paths. The bot doesn’t know or care whether you paid — it cares whether your name, trade, and town appear on a page that ranks for the question being asked.
The misfire side: listicles can get you wrong
A Plant City plumber’s owner-written FAQ documents the other edge of this: “A ‘serves Plant City’ line on a directory can mean a truck that drives over from another metro when the board has a gap.” His shop is headquartered in Plant City; the listicles hand the town to whoever bought the line. If you’re not watching your directory listings, the listicle isn’t just ignoring you — it may be actively mislocating you.
What to actually do about it
Find your two or three. On Bing, search “best [your trade] in [your city]” the way a homeowner would. The listicles that rank are the ones the bot reads. That’s your list — not fifty directories, just the two or three that actually rank.
Get listed on the free path. Claim or create the free listing on each. Fill it out completely: services, service area, phone number, website.
Keep your facts identical everywhere. Same business name, same phone number, same towns on every listing and your own site. Conflicting facts are how you get skipped — or misdescribed.
Fix wrong information. If a listicle has your old phone number, the wrong town, or a competitor’s truck on your line, correct it. The bot quotes what’s there.
You don’t need the ads. Paid placement on a directory is a separate purchase from being listed. The citation evidence comes from the listing, not the ad spend.
What’s actually known — and what’s not
Known: listicles and directories are a major citation source for AI answers — roughly a fifth of citations, and near-total absence from them collapses your naming rate to single digits. The fix is getting accurately listed on the few that rank, not buying your way onto all of them.
Not known: exactly which listicles any given engine prefers for any given trade and city — that shifts with rankings. Nobody has published a per-market map of “these three listicles decide the plumber answers in Phoenix.” The practical move is checking your own market’s rankings directly, because that’s what the bot is reading today.
Short answer: Mostly, yes. When ChatGPT goes looking for live information on the web, it searches through Bing’s index — not Google’s. If your business isn’t indexed by Bing and isn’t claimed on Bing Places, ChatGPT’s live-search layer has no way to find you. Everything you built on Google — your rankings, your reviews, your Google Business Profile — doesn’t transfer to that layer.
Why your Google work doesn’t carry over
This is the part that stings. You spent years — maybe money, too — getting your Google presence right. Then a homeowner asks ChatGPT who to call, and none of it counts. That’s because ChatGPT reaches the open web through Microsoft’s Bing search infrastructure, not Google’s. One agency put it bluntly in a widely syndicated piece this year: “It Runs on Bing, Not Google.” A contractor who invested everything into Google rankings and ignored Bing Places is, in their words, essentially invisible to ChatGPT’s search layer.
An SEO vendor’s FAQ answers the owner version of this question directly: “Should I optimize for Bing if I already rank well on Google? Yes, ChatGPT uses Bing’s index when browsing the web. If you’re not indexed in Bing and listed in Bing Places, ChatGPT cannot find your business.”
What it looks like in practice
A Vienna-based test from October 2026 ran the scenario end to end: someone asked ChatGPT to recommend an installer in Vienna. ChatGPT searched live via Bing, returned three competitors — and marked the tester’s own firm “NICHT DABEI” (not there). The firm wasn’t failing at marketing. It was failing at being in the index the bot actually reads.
A Bend, Oregon owner’s check the same month found the same shape: the competitor who gets named is the one who ranks on Bing for the question being asked. Your Google position never enters the picture.
The “my SEO guy says we’re covered” myth
If your SEO provider tells you your Google work covers you for AI search, ask them one question: when did you last check my Bing presence? Google-only SEO is a real thing — plenty of shops do excellent Google work and never touch Bing, because for a decade that was a defensible call. It isn’t anymore. The AI layer that now sits between the homeowner and the phone call reads a different index, and “we’re covered” without a Bing check is a guess.
What to actually do about it
The good news: this is a five-minute fix, not a six-month project.
Claim your Bing Places listing. It’s free, it’s separate from your Google Business Profile, and it’s a real listing that feeds ChatGPT’s search layer. Most contractors have never claimed theirs.
Check whether Bing has indexed your site. Search site:yourwebsite.com on Bing. If nothing comes up, Bing doesn’t know your site exists — and neither does ChatGPT’s browsing layer.
Set up Bing Webmaster Tools. Free, takes minutes, and shows you exactly what Bing sees (or doesn’t).
Keep your facts identical everywhere. Same business name, same phone number, same service area on your site, Bing Places, and Google Business Profile. Mismatched facts are how businesses get misdescribed or skipped.
What’s actually known — and what’s not
Known: ChatGPT’s live web browsing runs on Bing’s search infrastructure. Bing Places is a real business listing that feeds that layer — unlike the mythical “ChatGPT business registry,” which doesn’t exist. Contractors who are Google-only are structurally invisible to ChatGPT’s search layer until they fix their Bing presence.
Not known: exactly how much weight Bing Places carries versus organic Bing rankings in any given answer, or how often the underlying data refreshes. Nobody has published a controlled test of “claimed Bing Places on this date, started appearing on that date” for trades businesses. The mechanism is well-evidenced; the precise timing isn’t.
The short version: A new study ran ChatGPT’s local panel across 216 U.S. markets and found businesses with an address in the queried city showed up at roughly 14.4x the odds of businesses without one — ahead of reviews, ahead of ratings. That’s a descriptive finding, not a causal one. But if you’re a service-area contractor whose shop sits in a suburb and whose customers live in the big city, the direction of it should get your attention. Google tells you to hide your address. ChatGPT appears to reward having one. That’s the squeeze, and there’s an honest way through it.
Your shop is in Tukwila. Your trucks spend their days in Seattle. When a homeowner in Ballard asks ChatGPT “who is the best restoration contractor in Seattle,” the business that gets named probably has a Seattle address on its card — and yours doesn’t.
That’s not a hunch anymore. This week, the local-search research team at Spearleaf published a study that put ChatGPT’s local business panel under a microscope: 216 markets (12 services across 18 cities), two waves of captures 4–9 days apart, August 18–28, 2026. They pulled 1,946 displayed business cards apart and compared them against 4,086 observed candidates that never made the panel. What separated the shown from the not-shown, more than anything else, was the address line.
Businesses with an in-city address appeared at 14.4 times the odds of businesses without one (95% CI [10.3, 21.5]). For context, that’s bigger than the review-volume effect (1.81x per doubling of reviews) and bigger than the rating effect (1.36x per tenth of a star). 92.0% of displayed cards carried an in-city address, versus 73.9% of the candidates that didn’t get displayed.
Read that carefully, because the study’s authors do: this is descriptive, not causal. ChatGPT isn’t necessarily deciding on the address. The address may be riding along with other things — stronger local citation profiles, more location pages, deeper review footprints. Correlation with a megaphone. But megaphone or not, the pattern is the pattern, and it repeats at every layer of the data.
The part that should worry a service-area business
Here’s where it gets uncomfortable for contractors. Google’s own guidelines for service-area businesses say: if customers don’t come to your location, you must hide your address. One profile per service area. Up to 20 named service areas. Roughly a two-hour driving-time boundary.
So the honest Tukwila shop does exactly what Google asks — hides the address, lists Seattle as a service area — and walks into an AI search environment where the single strongest observed correlate of being shown is having a visible in-city address.
Nobody is telling you to fake one. Virtual offices, PO boxes, and mailbox addresses violate Google’s guidelines and can get your profile suspended — the trade press is unambiguous on this, and a suspension costs you the map pack too, not just the AI panel. Don’t trade a real asset for a maybe. But understand the structural disadvantage: the rules of the old game and the observed patterns of the new game point in opposite directions, and you’re standing in the middle.
What the survivors had
The study didn’t just measure the address effect. It measured what the businesses that kept their panel spots across both waves looked like, and that’s the actionable part:
Reviews are the bench you sit on. Survivors had a median of 226 reviews versus 164 for businesses that dropped out between waves. The median rating was 4.9 in both groups — rating gets you in the room, volume keeps you in the chair. And the panel-minimum rating held at 4.8 across every city tier. Below that floor, you’re not in the conversation.
Almost half the panel turns over. Only 48.2% of businesses shown in wave one appeared again in wave two. The same business held #1 in both waves in just 34.1% of markets. Compare that to Google’s local pack, which held 0.82 overlap wave-to-wave against ChatGPT’s 0.36. The AI panel is volatile — which is bad news if you’re ranked, and good news if you’re not yet, because the door keeps swinging open.
Yelp matters more than you’d guess. 17.4% of resolved rating cards showed Yelp ratings rather than Google’s. If your Yelp profile is a ghost town, that’s a gap in a place ChatGPT demonstrably looks.
ChatGPT reads the review sites, not just Google. The most-retrieved domain across the study was reviews.birdeye.com (37.7% of markets). Roofers skewed toward expertise.com, plumbers toward bestprosintown.com, HVAC toward consumeraffairs.com. Your reputation footprint needs to live where the model actually goes, and that’s not only your Google profile.
The prompt’s city is the city. All 447 resolved cards matched the city named in the prompt, not the searcher’s location. Geography in AI search is declared, not detected. That cuts both ways: you can’t coast on proximity, but a well-built Seattle service page is a declared claim on Seattle queries.
The honest playbook
So what does the Tukwila shop do — the one that won’t fake an address and shouldn’t?
Build the review bench like it’s the job. 226 reviews is the median of the survivors, and the 4.8 floor is non-negotiable. This is unglamorous and it’s the whole game. Every finished job is a review request. No exceptions, no “we’ll ask the happy ones.”
Fix Yelp. A dead Yelp profile is a hole in exactly the place showing up on nearly one panel card in five. Claim it, fill it, feed it reviews.
Be present on the domains the model retrieves. Birdeye, and whatever the vertical leaders are for your trade. These are citation surfaces now, not just review sites.
Build real city pages for the cities you serve. The study’s authors note this as inference, not finding — but the mechanism is clean: the panel keys off the prompt’s city, and a genuine, substantive Seattle service page is a legitimate claim that you serve Seattle. Not a doorway page. A real page with real job photos, real service detail, real local proof.
Treat the panel as volatile and act like it. Half the names change between waves. That means a competitor’s spot is never safe — and neither is yours. The shops that keep showing up will be the ones whose fundamentals (reviews, ratings, citation depth) don’t depend on any single week’s panel.
And the thing you don’t do: don’t rent a fake Seattle address. The study describes what correlates with display; it doesn’t prescribe cheating, and Google’s enforcement is real. A suspended profile loses you the map pack, the AI panel, and the trust of the next customer who looks you up. Play the long game — it’s the only one with compounding returns.
Why this matters now
AI search is still young enough that its patterns are being mapped in public, by independent researchers, in real time. That window doesn’t stay open. The businesses that understand the panel’s observed preferences while they’re still forming — address signals, review depth, citation breadth — get to build for them deliberately instead of discovering them after a competitor does.
Your shop’s in Tukwila. That’s fine. Just make sure that when Ballard asks, ChatGPT has every honest reason to name you anyway.
Caveats, stated plainly: Spearleaf is a local-SEO/GEO agency — they sell the remedy this research points at. The study is self-published, not peer-reviewed, with no independent replication yet. Every odds ratio above is descriptive, not causal. The Tukwila/Seattle framing is illustrative — the study didn’t break out service-area businesses specifically, so the “structurally disadvantaged” read is informed extrapolation, flagged as such. Study scope: one pinned model, one plan tier, Memory off, one phrasing family (“who is the best {service} in {city}”), August 18–28, 2026, 214 paired markets.
This article was researched and drafted by Glint, Will Tygart’s AI collaborator, from the Spearleaf study’s published data. Every statistic above is traceable to the source report.
Want this applied to your shop? Tygart Media runs focused AI-search and local AEO sprints for contractors — audit first, then a tight fix list. Talk to us.
Direct answer: The data can’t crown a winner — and that’s the answer. “No AI search platform has been shown to bring better leads than another; what differs is which sources each one trusts.” (BaaDigi, Sept 2026.) But the three engines drink from radically different wells, and knowing which well is which tells you exactly where to spend your effort. Stop asking which engine to bet on. Start asking which sources each engine trusts — then feed those sources.
The question behind the question
When a contractor asks “which AI should I care about,” they mean: I have limited time and money — where does it pay off? It’s a budget-allocation question disguised as a tech question. And the honest answer, from the best contractor-vertical study available, refuses to pick a winner — because lead quality was never measured. Citations were.
BaaDigi ran 88 contractor-marketing questions across all three engines in August 2026 and collected 1,429 answers (updated September 23, 2026). The headline finding isn’t a ranking. It’s a split: each engine trusts a different slice of the web. (BaaDigi, “Which AI Search Platform Brings Better Leads?”)
Read the rows, not just the totals. Perplexity leans on Reddit almost 3x harder than ChatGPT does. Google AI Overviews leans on YouTube 53x harder than ChatGPT does (214 vs. 4). LinkedIn is a Perplexity phenomenon (246) that barely registers for ChatGPT (6). And google.com — Google’s own domain — appears 310 times in AI Overviews and literally zero times in ChatGPT or Perplexity answers.
As BaaDigi puts it: “A page that Perplexity quotes may never surface in an AI Overview. That is why one screenshot from one engine says little about the other two.”
The pattern matches what practitioners report engine by engine: Perplexity rewards specific, substantive websites; ChatGPT leans on review platforms and directories; AI Overviews lean on Google’s local-pack signals. Different wells, different water.
Why “which one sends leads” is the wrong bet
Here’s the sentence that should reframe your budget: “A citation proves a page was used in an answer. It does not prove a customer read it, visited you or called.”
Nobody — not BaaDigi, not the agencies, not the platforms — has published measured lead-quality data comparing the three engines for contractors. Anyone selling you a ranking (“ChatGPT buyers convert 2x better”) is inventing conversion rates. BaaDigi’s guide says so explicitly: “It does not declare a national winner or invent conversion rates.”
And the usage picture is genuinely unclear. Surveys show a growing share of customers asking AI for local recommendations, but every study counts it differently: Kordless claims 62% of consumers now use AI tools to research products and services before buying (their own marketing page, no study cited — an independent Bazaarvoice survey of 3,600+ adults landed on the same 62% for AI-assisted shopping). Google’s AI Overviews show up on roughly half of tracked searches (BrightEdge, Feb 2026) — but only about 7% of local queries. And Pew’s 2025 study found users click an organic result 47% less often when an AI Overview is on the page (15% click-through dropping to 8%). Perplexity is the smallest audience with arguably the most research-intent users. Each of those facts points a different direction, which is why the “just tell me which one” demand can’t be satisfied honestly.
The reframe: bet on sources, not engines
Since you can’t pick a winning engine, pick the source pools — because one fix often feeds multiple engines:
Feed ChatGPT: review platforms and directories. ChatGPT’s answers lean on Yelp (3.4x more citations than the next platform across 28M+ AI answers — Foundation Marketing + AirOps, May 2026), Reddit threads, and structured directories. Complete Yelp profile, steady specific reviews, accurate directory data. This is also where the in-chat “Request a Quote” button lives now.
Feed Perplexity: your own website, in depth. Perplexity cites specific websites far more than the others — 246 LinkedIn citations and heavy Reddit use, but also the engine most likely to quote your page if the page actually answers the question. Answer-first service pages, real job detail, quotable sentences. If you only fix one thing for Perplexity, make your site worth quoting.
Feed AI Overviews: Google’s local signals. AI Overviews cite google.com 310 times to the others’ zero — the local pack, your Google Business Profile, and YouTube (214 citations). Complete GBP, real job videos on YouTube, consistent NAP. The AIO game is closer to classic local SEO than the other two.
Notice what just happened: the three work lists barely overlap, and none of them is “optimize for the engine.” They’re all be legible where that engine looks. Do all three and you’ve covered the field. Do one and you’ve placed a bet you can’t evaluate.
The measurement that actually answers “which pays off”
BaaDigi’s guide proposes the only honest version of this comparison — run it in your own office:
Ask the same buyer questions across all three engines. Same services, same cities, saved with dates. Keep “feature not shown,” “business not named,” and “source unavailable” as separate statuses — they’re different observations.
Track by stage, not by screenshot. Observed appearance → website visit → inquiry → qualified opportunity → customer. A citation is stage zero. “Compare inquiry records, not screenshots.”
Define qualified before you look. Accepted service, actual territory, a need your crew can handle. Track duplicates and spam separately.
Label uncertainty. A customer saying “found you through AI” goes in the record as a self-reported source — it doesn’t authorize you to invent which engine, which prompt, or which citation.
Run that for 90 days and you’ll know which engine sends you leads, in your market, for your services. Nobody else’s data can tell you that. The national studies tell you where to look; only your ledger tells you what pays.
If you run the checks and find yourself absent everywhere, that’s normal — absence is the starting point, not an emergency. In 254 free BaaDigi audits run March through September 2026, Perplexity named the audited business for its own service-and-city query only 23.2% of the time, with a median of three competitors listed ahead. You’re not behind. You’re at the baseline, with three wells to start filling.
And don’t abandon what’s working: “Do not abandon working search, referral or advertising activity because an assistant produced an attractive answer. A channel decision needs costs, capacity and outcomes.”
The line to remember
There is no national winner, and anyone selling you one is selling certainty they don’t have. The engines don’t compete for your attention — they compete for different evidence. Feed all three wells: reviews and directories for ChatGPT, a quotable website for Perplexity, Google-local signals for AI Overviews. Then let your own inquiry ledger — not a screenshot — tell you which one pays.
FAQ
Q: So I have to do three times the work? A: No — the work overlaps heavily. A complete Yelp profile, specific reviews, answer-shaped service pages, an accurate GBP, and real job videos cover all three engines. It’s one body of legibility work, not three campaigns.
Q: What about Gemini and Copilot? A: The contractor-vertical studies cover ChatGPT, Perplexity, and AI Overviews. In practice, Gemini’s answers draw on Google’s ecosystem (closer to the AIO well) and Copilot’s draw on Bing — same source-pool logic, just without a contractor study measuring it yet.
Q: Should I pay for a tool that tracks all three? A: Only after you’ve run the manual version for a month. If you can’t interpret three screenshots by hand, a dashboard of three hundred won’t help. Measurement discipline first, tooling second.
Q: Does being cited mean I’ll get calls? A: No. A citation means your page was used in an answer. Calls come from being recommended — named as the answer — with a working path to contact you. Track the stages separately.
Direct answer: Yelp gets the rails, your competitor gets the job if you’re not on them. The “Request a Quote” button inside ChatGPT is Yelp’s feature, delivered through the Yelp–OpenAI data deal — and one detailed write-up of the arrangement says a quote request submitted inside ChatGPT is treated as a billable Yelp lead, the same economic event as a lead generated in the Yelp app. Neither Yelp nor OpenAI has confirmed that part, and nobody has published the per-lead price or whether in-chat requests carry a source tag. The business still gets the lead. But if the reporting holds, it arrives through Yelp’s plumbing, at Yelp’s per-lead price, with no source tag telling you it came from ChatGPT.
The scene nobody planned for
PushLeads, a contractor-marketing shop, put it as a dare in a September 2026 video: “Ask ChatGPT to find you a water damage company in your town. Go ahead, try it tonight. Somebody’s business comes back with a name, a rating, and a button that says ‘request a quote.’”
Sit with that image. A homeowner never opens Google. Never sees your website. Never sees an ad. They describe the problem to ChatGPT, ChatGPT names a business, and right under the name is a button that starts the job request — inside the chat. The question this page answers is the one nobody in the trade press has asked: when a stranger taps that button, whose system processes the lead, who bills for it, and what does the winning business have to have in place to be the name on the button?
Why the button says Yelp
The button exists because of the Yelp–OpenAI deal. Here’s the timeline, with the one discrepancy flagged honestly:
February 2026: Yelp disclosed an agreement with OpenAI in its shareholder letter announcing 2025 results, with CEO Jeremy Stoppelman saying the company had “recently signed an agreement with OpenAI.”
July 23, 2026: Axios reported the details — ChatGPT would surface Yelp reviews, star ratings, photos, and business details inside local answers, with Yelp branding and backlinks, plus a Request-a-Quote button letting users contact a service business without leaving the chat. Yelp’s stock rose 8% on the report. (One source, PushLeads, dates the announcement to July 23, 2025; every other account — Axios via multiple outlets, Yelp’s own February 2026 disclosure — points to 2026. Treat the 2025 date as an error.)
August 2026: The integration rolled into ChatGPT. A September 2026 survey of AI-search data sources notes that Yelp’s 10-Q confirms the in-chat Request a Quote feature is live.
Because the models trust it more than anything else in local. An analysis of more than 28 million AI responses to local business queries across ChatGPT, Gemini, Perplexity, and Google AI Mode — covering Q4 2025, published May 28, 2026 by Foundation Marketing and AirOps — found Yelp earned 512,680 citations, 3.4 times more than the second-ranked platform (the BBB at 149,710) and more than all five tracked competitors combined. LMH Agency’s August 2026 write-up of the same data calls Yelp “the single source AI tools cite most” for contractor queries. (ppc.land; LMH Agency)
The licensing corpus is the moat: roughly 330 million reviews and more than 8 million business listings, now piped into the fastest-growing answer engine on earth. For a contractor who spent a decade hating Yelp — the review filter, the sales calls, the ad treadmill — this is a genuine reversal. The platform you dismissed is now the citation gateway. The reviews you stopped tending are an input to the machine recommending your competitors.
LMH puts the mechanism plainly: when a question has money attached, the model reaches for a source the reader will believe, and Yelp carries reviews, photos, hours, service categories, and structured business data in one place. “Your Yelp page is quietly becoming your storefront on platforms you never signed up for.”
So who gets the lead? Follow the money.
Here’s the part that matters for your P&L. One write-up of the deal’s structure (ainvest.com, September 2026 — the only outlet to describe the billing mechanics) describes the load-bearing detail this way, and none of it has been confirmed by Yelp:
A quote request submitted from inside ChatGPT counts as a billable Yelp lead — the same economic event as a lead generated in the Yelp app (reported, not Yelp-confirmed).
The per-lead price is unpublished.
The leads carry no source tag, so the business can’t tell a ChatGPT lead from an app lead (reported, not Yelp-confirmed).
OpenAI controls how the content is presented; Yelp’s management attached no specific revenue number to the partnership.
Read that as an owner. The homeowner taps the button in ChatGPT. The request lands in your Yelp inbox (or wherever your Yelp leads route). You pay Yelp’s lead price for it — at least that’s the write-up’s read of how the billing works; Yelp hasn’t confirmed it. You never know ChatGPT was involved. OpenAI decides which businesses get the button and how it looks.
So the honest answer to the headline question has three parts:
The business gets the lead — if its Yelp profile is claimed, complete, and set up to receive quote requests.
Yelp gets the billing event — on the reporting so far, it’s Yelp’s lead product, on Yelp’s rails, at Yelp’s price.
OpenAI gets the placement decision — which businesses appear with the button is OpenAI’s call, not yours and not Yelp’s.
If you are not on Yelp — no claimed profile, Request a Quote not enabled, categories wrong — you are not in the running for the button at all. Somebody else’s name is under it.
The second door: Angi bought its own entrance
While Yelp became the citation layer, Angi bought the front door. On September 16, 2026, OpenAI launched the Sponsored Agents pilot — a ChatGPT ad format where tapping the ad opens a separate, clearly-labeled conversation with the brand’s own AI agent. Angi was among the first pilots (alongside Wayfair, Newegg, Best Buy, Lowe’s, and VistaPrint). Angi’s own September 16 release says its agent can appear in home-services conversations and hand the homeowner off to Angi’s service request flow to get matched with a local pro. (aieranews.com; Angi via GlobeNewswire)
Two different doors inside ChatGPT now route to two different intermediaries: the organic citation path runs through Yelp’s data and Yelp’s quote button; the paid path runs through Angi’s agent into Angi’s matching flow. Neither door is your website. And the paid door, per aerianews’ math on Angi’s Q2 2026 numbers, still costs what the marketplace always cost — about $44.50 a lead across 106,000 monthly active pros. A new front door doesn’t change what the marketplace charges the people standing behind it.
Worth noting: Sponsored Agents are in limited alpha — OpenAI’s help page says they’re “available only to selected advertisers” and not accepting access requests. As aerianews put it: anyone selling you placement in ChatGPT’s Sponsored Agents right now is selling something that is not for sale.
What to do before the next homeowner taps the button
Claim and complete your Yelp profile. Categories, service areas, hours, photos of real work, license info. This is the record the button reads.
Enable Request a Quote and know your lead price. Find out what Yelp charges you per lead in your market before the first ChatGPT-routed request lands, so the invoice isn’t a surprise.
Watch response time. Quote-request leads decay fast. If the request routes to an inbox nobody checks, you’re paying for introductions you never make. Yelp’s $270 million acquisition of Hatch — an AI lead-management platform — tells you where Yelp thinks the money is: in the follow-up, not just the introduction.
Ask Yelp directly how in-chat requests are labeled. As of September 2026, reporting says they carry no source tag. That may change. You want to know which of your “Yelp leads” are actually ChatGPT leads, because the homeowner’s expectations — instant, conversational, in-chat — are different.
Don’t confuse the two doors. Organic citation (Yelp data, reviews, profile completeness) and paid placement (Angi’s agent, sponsored formats) are separate games with separate costs. Play the organic one first — it’s the one you can influence this week.
The questions nobody has answered yet
Honest gaps, stated plainly: nobody has published what the per-lead price is for a ChatGPT-routed request versus an app-routed one. Nobody has confirmed whether the homeowner sees any Yelp branding at the moment of tap. Nobody has shown whether enabling Request a Quote changes your odds of being named in the answer, or only your odds of carrying the button once named. These are the measurements worth running — and the vendors worth pressing.
The line to remember
The homeowner’s journey now goes: problem → ChatGPT → a name → a button → a lead. Your website is not in that chain. Yelp is. Whether you ever liked Yelp is now a historical question, like whether you liked the phone book. The button is real, the leads look billable, and the only vote you get is a complete profile.
FAQ
Q: Do I have to advertise on Yelp to get the button? A: No published source says advertising is required. What’s required is a claimed, complete profile with Request a Quote enabled. That said, Yelp’s lead product is the monetization — expect the economics to favor Yelp either way.
Q: Will the homeowner know the lead went through Yelp? A: Yelp branding and links appear when its content is used in answers, per the Axios reporting. At the moment of the tap itself, the exact presentation is OpenAI’s design decision and hasn’t been documented in detail.
Q: Can I get the button without Yelp — through my own site? A: Not through this integration. The in-chat Request a Quote is Yelp’s feature. (Separately, AI agents are beginning to visit business websites on customers’ behalf to compare companies and request quotes — BaaDigi, Sept 2026 — but that’s your site being browsed, not a button in the answer.)
Q: Is this just for big markets? A: The rollout is early. Coverage by market hasn’t been published. The profile work is worth doing regardless — it feeds every AI surface, not just this button.
Direct answer: No — but you need to understand why the question exists. In 511 answers ChatGPT gave to 88 contractor-marketing prompts (BaaDigi study, Aug 2026), reddit.com was cited 136 times and google.com zero times, and nothing in that sample came from a Google Business Profile. Reddit wins citations because Reddit threads answer the buyer’s question while your services page just lists services. The fix is not “get on Reddit.” The fix is to become the kind of source that gets quoted — on Reddit and everywhere else.
BaaDigi, a contractor-marketing agency, ran 88 prompts the way a homeowner would ask them and collected 511 answers from ChatGPT in August 2026, updating the write-up September 23, 2026. Across those answers, reddit.com appeared as a cited source 136 times. google.com appeared zero times. No Google Business Profile contributed a single citation. (BaaDigi, “Why Does ChatGPT Recommend Local Businesses?”)
That ratio — 136 to 0 — is doing all the work in this debate. It is worth sitting with before reacting to it. ChatGPT did not decide Reddit is better than your company. ChatGPT assembled answers from the pages its search tool retrieved, and for contractor questions, the pages that keep getting retrieved look like Reddit threads and directories, not contractor websites.
Why Reddit threads answer and your website doesn’t
The mechanism was stated plainly by the team at digitaldomination.ai: “Because those pages answer the question and your website describes your services. A Reddit thread titled who is a good electrician in this town contains exactly the language and structure a model needs. Your services page contains a list of things you do. Only one of those can be quoted as an answer.” (digitaldomination.ai)
Read that twice, because it is the whole game. A homeowner asks, “who should I call for a slab leak in Katy?” A Reddit thread literally contains neighbors naming names and saying why. Your plumbing page says “We offer slab leak detection and repair.” A model building an answer can lift the first one. It can only summarize the second. Models quote what answers the question.
A Medium essay by Radusferlic (June 2026) gave this the name it deserves: ChatGPT is “a consensus engine, not a ranking engine.” It does not crawl your homepage and score it. It builds a verdict from what the rest of the internet says about you — reviews, directories, articles, forums, “best of” lists. “The recommended ones are talked about — consistently, in multiple places, by sources the model trusts.” (Medium)
That is the uncomfortable sentence: to the model, your web silence reads as absence. An excellent company nobody mentions online is, for recommendation purposes, the same as a company that doesn’t exist.
Three separate facts get mashed into one rumor
Fact one: Reddit content is heavily indexed and recommendation-shaped. Reddit threads carry first-person recommendation language (“we used X, they showed up same day, cost about $400”), and OpenAI and Reddit have a partnership, announced May 16, 2024, that gives ChatGPT access to Reddit’s Data API — which digitaldomination.ai notes as one reason Reddit appears in citations “far more often than its size would suggest.” When the question is a comparison — which plumber, which roofer — directories get cited for the same structural reason: they present comparable information about many businesses at once, which is exactly what a model needs when the question is a comparison.
Fact two: most businesses are simply absent from the conversation. A Search Engine Journal recap of an Uberall session reported that when someone asks ChatGPT, Gemini, or Perplexity a question about a category, the model reads 5 to 16 different sources before answering — and your own website accounts for about 15% of what it finds. The rest comes from Reddit threads, review platforms, directories, and forums. Roughly three-quarters of businesses are absent from the AI conversations happening about their category. If a Reddit thread in your category exists and you’re not in it, a competitor or a wrong answer fills the space. (Search Engine Journal)
Fact three: the pattern moves. This is the part the Reddit maximalists skip. In August 2026, ChatGPT’s search changed how it retrieves the web — shifting toward site-scoped queries against specific trusted domains — and Reddit’s share of visible ChatGPT citations reportedly fell roughly 86%, per reporting digitaldomination.ai cited from Axios. (An independent analysis on Medium by Analyst Uttam documented the same August 8, 2026 shift, noting that official documentation and help centers rose as Reddit fell.) (digitaldomination.ai; Medium)
Three facts, one conclusion: Reddit matters because it is a shape of evidence — real people answering real questions in quotable sentences — and that shape is what gets lifted. But any single source can fall out of favor overnight. The durable strategy is to be legible as an entity everywhere, not to rent one channel.
What “being on Reddit” actually means
There are three rungs, and most contractors only need the first two.
Rung one: get mentioned. Somebody in r/plumbing, your city’s subreddit, or a homeowner thread names your company with a specific story attached — the job, the price range, the crew member’s name. You don’t write it. A customer does. This is the hardest rung to control and the most valuable.
Rung two: be present. A profile that matches your real business name, occasional genuine answers to trade questions (not pitches), an AMA if you have the temperament for it. Presence makes you findable and real; it rarely drives citations by itself.
Rung three: get recommended repeatedly. This is what the 136 citations represent — threads where the model found your name attached to a specific, quotable recommendation. You cannot manufacture this. You can only earn it by doing work people talk about, then making it easy for them to talk about it precisely (ask for reviews that name the job, the material, the outcome — not just stars).
Search Reddit for your company name and your trade + your city. See what exists. Most contractors will find nothing — which means the space is empty, not occupied by competitors. Empty space is an opportunity.
Fix your own answer-shaped pages first. Publish pages that answer the actual questions in your trade in quotable sentences: what a job costs in your area, how long it takes, what happens on the first visit, what the common failure modes are. As digitaldomination.ai puts it: “Give a model something worth lifting and it will lift it.” Your website should be the easiest thing on the internet to quote about your own work.
Seed precise review language. Reviews that say “great service” teach the model nothing. Reviews that say “they re-piped our 1970s copper with PEX in two days and the city inspector passed it first try” are matchable to real questions. Ask for the specifics.
Participate on Reddit like a neighbor, not a marketer. Answer trade questions in relevant subreddits without pitching. One useful comment history is worth more than ten promotional posts — and the promotional posts are what get you banned and what get cited as spam.
Do not buy Reddit placement. Any vendor selling guaranteed Reddit mentions in ChatGPT answers is selling what BaaDigi’s own study warns against: “Do not buy a package promising placement because you reached a review count or installed schema.” Astroturfed threads are detectable, removable, and — when discovered — they poison the entity instead of helping it.
The line to remember
You don’t need to be on Reddit. You need to be quotable everywhere Reddit-style evidence lives — threads, reviews, directories, roundups — in sentences a model can lift whole. The 136-to-0 number isn’t a verdict that Reddit beats your website. It’s a verdict that answered questions beat service lists. Write the answers.
FAQ
Q: Will posting on Reddit myself make ChatGPT recommend me? A: Probably not directly, and spammy self-promotion backfires. Genuine participation builds a real presence; citations come from threads where other people recommend you with specifics. The highest-leverage move is making customers’ recommendations quotable.
Q: Is my Google Business Profile useless for ChatGPT then? A: Not useless — keep tending your Google profile as the front door; it feeds the directories and aggregators the models read, and it anchors your entity’s facts (hours, services, location). But the BaaDigi data shows it is not itself a citation source in ChatGPT answers. Keep it accurate; don’t expect it to win recommendations alone.
Q: What if competitors are trashing me on Reddit? A: That’s a different problem — reputation defense, not discovery — and it has its own playbook. Monitor your name monthly, respond factually where the platform allows it, and make sure the accurate record (your site, your profiles, your reviews) outweighs the attack in volume and specificity.
Q: Didn’t ChatGPT stop citing Reddit in August 2026? A: Reddit’s share of visible citations dropped sharply after a retrieval change — it didn’t disappear. The lesson isn’t “Reddit is dead” or “Reddit is everything.” It’s that single-source bets are fragile and entity legibility across many sources is the durable play.
Direct answer: Type it. After any AI engine recommends a business — yours or a competitor’s — ask the follow-up: “Why did you recommend them?” The engine will often tell you which signals it used: the reviews it read, the directory it trusted, the facts that tipped the decision. It’s free competitive intelligence, it takes five minutes, and almost nobody in the trades is doing it.
Where this comes from
CI Web Group, a digital agency, published a checklist called “The AI Interview: What Answer Engines Ask About You.” Buried in it as step 5 of a 20-minute self-check is the single most useful sentence in the AI-visibility literature this year:
> “Ask a follow-up: ‘Why did you recommend them?’ The engine will often tell you which signals it used. Free competitive intelligence.”
The full checklist is worth your twenty minutes — open ChatGPT, Perplexity, and Gemini in separate tabs; type the exact question a homeowner would ask for your top three services and your top three cities (“Best plumber in Katy for a slab leak” beats “plumber Katy”); screenshot every answer; note who gets named, who gets skipped, and which facts about your business are wrong; run the follow-up; trace every error to its source; repeat monthly. (CI Web Group)
But the follow-up question is the hinge. Everything else is observation. The follow-up is interrogation.
Why it works
When ChatGPT, Perplexity, or Gemini recommends a business, it has just done retrieval: it searched the web, pulled sources, and synthesized. When you ask why, you’re asking it to narrate that retrieval. The engine will typically name the kinds of signals that carried weight — review volume and recency on a specific platform, a directory profile with complete service data, mentions across multiple independent sources, specific review language matching the question.
Is the explanation perfectly faithful to the model’s internal process? No — and you should know that. The “why” is itself a generated answer: a plausible reconstruction, not a system log. Treat it the way you’d treat a rival estimator explaining his bid: informative, self-serving in places, and most valuable when you cross-check it against the evidence (the actual citations in the first answer, which you screenshotted).
Even with that caveat, it’s the cheapest competitive intelligence in marketing. An agency will happily sell you a “competitor gap analysis” that tells you less — and bill you for the privilege.
The 5-minute procedure (do it tonight)
Minute 1 — Ask the buyer question. Open ChatGPT (or Perplexity, or Gemini — run all three if you have ten minutes). Type exactly what a homeowner would type. Not keywords. A question. Include the service and the city: “Who’s the best plumber in Katy for a slab leak repair?” Screenshot the answer.
Minute 2 — Ask why. Type: “Why did you recommend [the named business]?” Use their exact name from the answer. Screenshot what comes back. You’re looking for signal names: review platforms, specific review counts, directory profiles, “mentioned across multiple sources,” website content it quotes.
Minute 3 — Ask about the sources. Follow up with: “Which specific reviews or pages influenced that recommendation?” and “What would make you recommend a different company for this job?” The second question is the money question — it tells you the gap between you and the winner in the engine’s own words.
Minute 4 — Run it for your business. Now ask about yourself by name: “What do you know about [Your Company] in [City]?” Then: “Why didn’t you recommend them for [the job]?” Screenshot everything. The engine will often list what’s missing — thin reviews, no directory presence, conflicting hours, an unclaimed profile.
Minute 5 — Write down the three gaps. Not ten. Three. The three missing signals the engine named most specifically. Those are your work orders for the month.
What you’ll typically learn
About the winner: which review platform carried the recommendation (often Yelp or Google reviews, sometimes a directory you ignore), whether the win came from review language matching the question rather than review count, and whether the business is even good or just legible. Scott Tischler’s July 2026 experiment found the named winner often isn’t the best-reputed shop in town — it’s “the one that was legible to a machine.” The interrogation tells you which legibility won.
About yourself: SOCi’s 2026 Local Visibility Index puts business profile accuracy on ChatGPT and Perplexity at about 68% — versus 100% on Gemini, which pulls straight from Google Maps — so expect the engine’s picture of your business to contain errors. Wrong hours, wrong services, a closed flag, an old phone number. Each error has a source, and the source is fixable. As CI Web Group puts it: “Wrong hours on ChatGPT usually means wrong hours on a directory the engine trusts. Fix the source, not the chatbot. You cannot argue with the machine. You can only feed it better facts.”
About the game: run the same questions across engines and you’ll see different winners with different reasons — which is exactly what the “which AI should I care about” analysis shows. The interrogation teaches you that there is no single ranking to climb. There are separate evidence pools, and the follow-up shows you which pool each engine drank from.
Three traps to avoid
Trap one: treating one answer as the truth. AI answers are non-deterministic — the same question tomorrow can name a different business. Run the interrogation two or three times across a week before you spend money on what it told you. One screenshot is an anecdote; three is a pattern.
Trap two: arguing with the engine. Telling ChatGPT “that’s wrong, I’m better” accomplishes nothing. The engine restates what the web says. Change the web — the reviews, the directory data, the pages — and the answer follows on the next crawl. The checklist’s last line is the whole philosophy: “Repeat monthly. This is a vital sign now, like checking your reviews. Operationalize it with a LLM visibility measurement stack.”
Trap three: interrogating once and filing it. The signals change. In August 2026, ChatGPT’s retrieval shifted and Reddit’s citation share fell off a cliff — the “why” answers from July would have named sources that stopped mattering in September. Monthly is the cadence. Put it on the calendar next to the review check.
What to do with the intel
Convert each of the three gaps into a source fix, not a chatbot fix:
“Recommended them because of 200+ recent Google reviews mentioning slab leak work” → run a review campaign asking specifically for job-type language, not stars.
“Their Yelp profile lists slab leak detection as a service with photos” → complete your Yelp categories and upload real job photos.
“Mentioned on three local ‘best of’ lists” → pitch the list publishers, or earn the mentions with work worth listing.
“Your hours conflict across two directories” → fix the source directories; the engine can’t resolve what you haven’t resolved.
Then re-run the interrogation next month and watch the “why” change. When the engine starts naming your signals unprompted, you’re winning.
The line to remember
Your competitor’s recommendation is a case file, and the engine will read it to you if you ask. Five minutes, three questions, zero dollars — “Why did you recommend them?” is the cheapest market research in the trades right now. Run it tonight, monthly after that, and fix sources instead of arguing with machines.
FAQ
Q: Will the engine actually answer honestly? A: It will answer plausibly. The explanation is generated, not a system log — treat it as a strong lead, not gospel. Cross-check against the citations in the original answer (which is why you screenshot first).
Q: Should I do this in ChatGPT, Perplexity, or Gemini? A: All three — they use different source pools and often name different winners. The procedure is identical; the intelligence differs. That’s the point.
Q: What if it recommends me and I ask why? A: Even better. You learn which of your assets is actually carrying the win, so you can protect it — and you learn the exact language to repeat in reviews, profiles, and pages.
Q: Can I automate this? A: You can script the prompts, but the judgment — which gap matters, which error to fix first — is still yours. Monthly, by hand, twenty minutes. Some things shouldn’t be delegated to the thing you’re auditing.
Research snapshot · September 17, 20267 platforms · 14 cited sources
“Always allow” is a scope, not a safety verdict.
The button can mean “for this session,” “for this command in this repo,” “for this site across devices,” or “everything, until you turn it off.” The wording looks universal. The permission is not.
What it usually means
“If this same kind of action happens again inside a defined boundary, don’t interrupt me.”
What it never means
“The system has decided this action is safe, wise, or appropriate forever.”
01
One label. Six possible boundaries.
Before approving, ask three things: what is being authorized, where the grant applies, and when it expires.
One actionApprove this exact send, command, purchase, or change once.
This sessionAllow the tool until the current conversation or work session ends.
Tool or patternAllow a named tool, command prefix, server, or similar operation.
Repo or sitePersist within a project, repository, browser site, or workspace.
User or deviceApply across workspaces on one machine, or across devices via cloud settings.
EverythingYOLO, bypass, or run-everything modes remove broad classes of checks.
Risk rises faster than convenience as the scope moves right.
02
How the major platforms differ
Filter the field. These behaviors come from vendor documentation or documented reporting; unresolved details are marked plainly.
Claude Code
Coding agent
repo + command
Shell-command “don’t ask again” grants persist per repository and command. File-edit approvals last only for the session.
Four settings layers: user, project, project-local, managed.
Deny rules evaluate before ask and allow.
Sensitive paths keep hard prompts.
Cursor
Coding agent
user + project
Auto-review, Allowlist, and Run Everything modes sit above user- and project-level permission files.
Rules can target MCP server:tool patterns.
Terminal rules match command prefixes.
Committed project rules can travel with the repo.
Gemini agents
Coding agent
tool + machine
Always-allow can target a tool, MCP server, or “similar operations.” YOLO/auto-approve is an IDE user setting.
User setting can span trusted workspaces on that machine.
CLI supports command-prefix auto-approval.
Restricted workspaces override YOLO.
ChatGPT agent
Browser agent
no standing grant documented
OpenAI documents per-action confirmations for high-impact actions and “watch mode” on certain sites, but not a general always-allow for agent confirmations.
Login uses human takeover.
Cookies can persist across sessions.
Scheduled-task confirmation behavior is undocumented.
ChatGPT Work
Cloud browser
site + account
Reported controls are per-site: Always ask, Auto approve, and Always allow. The setting follows cloud/account state across devices.
“Always allow” is reportedly marked not recommended.
Consequential actions keep a confirmation gate.
Official help-center documentation was not found.
Copilot Studio
Enterprise agent
rest of session
Makers gate tools per agent; users can approve once, approve for the rest of the session, or deny.
The gate is outside the agent’s own instructions.
Designed for sends, tickets, payments, and similar tools.
Governance can feed Power Platform audit systems.
Grok / Grok Bot
Cloud agent
undocumented
The research did not find reliable xAI documentation defining a standing approval’s scope, persistence, cross-chat reach, or revoke surface.
Do not infer Grok’s behavior from Claude, Cursor, Gemini, or Muse.
Treat each approval as local to the visible task until the product proves otherwise.
Keep consequential actions behind a separate human gate.
03
Does the approval travel?
Usually less than people fear—but sometimes farther than they expect. No researched vendor carries an approval into another vendor’s product.
Platform
Other chats
Other projects
Other devices
Other products
Claude Code
Yes, in same repo
No, unless user-level rule
No, local files
No evidence
Cursor
Yes
Only if rule is shared
Via committed repo file
No evidence
ChatGPT agent
n/a
n/a
n/a
No evidence
ChatGPT Work
Yes, per site
Yes, per site
Yes, cloud/account
No evidence
Copilot Studio
No, session only
No
No
No evidence
Gemini Code Assist
Yes, same IDE
Yes, user setting
Undocumented
No evidence
There is no universal “always.” There is only an approval attached to a boundary.
Main chat vs. project vs. Claude vs. Grok vs. Cursor: treat every surface as a separate authority domain until that product explicitly shows otherwise. Same account does not mean same grant. Same vendor does not mean same product. Similar wording does not mean similar scope.
04
Design the least-annoying safe gate
A practical rule engine based on the converging guidance: reserve human attention for the steps where it changes the outcome.
Approval recommender
Choose an action and its reach. This is a policy aid, not a vendor setting.
Action
Reach
Duration
Recommended gateAuto-run with an audit log
Read-only work inside your own workspace can usually proceed quietly. Log what was accessed and keep secrets excluded.
Quiet lane
Low consequence, reversible, internal.
Read/search
Draft/stage
Organize reversible files
Always log
One-tap lane
Meaningful external or production effect.
Send or publish
Deploy
Account setting
Show real target + content
Friction lane
Money, identity, access, deletion, or irreversible harm.
Typed approval or step-up auth
Bind approval to exact action
Short expiry
Never inherited from a vague grant
05
How standing approvals fail
The danger is rarely “the AI became evil.” It is usually a trusted tool, a changed context, a misleading prompt, or a tired human.
Approval fatigue
A prompt repeated often enough becomes a reflex. The gate still exists visually while meaningful review disappears. This is why tiering beats asking about everything.
Prompt injection through a trusted tool
EchoLeak showed how a crafted email could coerce Microsoft 365 Copilot into exfiltration. TrustFall showed how one generic “trust this folder” click could arm a malicious MCP configuration across coding agents.
Grant outlives the reason
A permanent Bash rule, per-site browser grant, or scheduled-task permission can remain after the original job is over. The next task inherits power it did not earn.
Scope contamination
Repo rules can affect every future task in the repo. Cursor project allowlists can be committed and inherited by teammates. A convenience decision becomes shared infrastructure.
Presented action differs from executed action
If the user sees the agent’s summary instead of the resolved recipient, command, or final payload, the approval can be technically genuine but practically uninformed.
“Run everything” becomes the workaround
If the system asks about trivial reads and destructive writes with equal urgency, users reach for YOLO or bypass modes. Bad UX can manufacture unsafe behavior.
The four repeated cards are not reassurance.
A gate that reappears until the user disables it is approval fatigue in miniature. Whether the repeats came from retry logic or delivery duplication, the safe response is to deduplicate the prompt—not train the user to approve more broadly.
06
No industry standard—yet
There is no binding specification that makes “always allow” mean the same thing everywhere. But the security guidance is converging.
Least agencyGrant the exact command, path, server, tool, recipient, and purpose—not a whole capability.
Time and task limitsPrefer once or session. Standing grants should expire or be reviewed.
Risk tiersRead, write, external send, payment, and security changes should not share one gate.
Per-action verificationPrivileged steps should be rechecked by a policy engine outside the agent prompt.
Presentation integrityShow the real recipient, final text, raw command, and resolved resource.
Immutable receiptsRecord what was shown, what was approved, and what actually executed.
Hard baselinesSecrets, account recovery, money, destructive commands, and broad access should keep non-bypassable checks.
Kill switchesEvery durable grant needs a visible list, revoke action, and safe fallback.
The best feature is not “always allow.” It is “allow this exact thing, for this purpose, until this time.”
Product opportunity: make the scope legible. Let users see a plain-language grant card, a live approval ledger, expiry/count limits, and a one-tap revoke. The system should reduce nagging by grouping low-risk work—not by quietly widening authority.
07
The practical rule for your setup
You already have the right doctrine. The research mainly sharpens where the lines belong.
Auto
Let it run and narrate after.
Reads and research
Drafts and staging
Reversible internal organization
Routine checks with no external effect
Tap
Keep the one-tap human gate.
Email and messaging
Publishing and deploys
Changing live settings
Actions affecting another person
Type
Make the friction intentional.
Money and purchases
Credential/security changes
Deletion or irreversible moves
Broad standing authority
Your “always allow” tap was not reckless.
It was a reasonable response to a low-value repeated prompt. The lesson is not “never use standing approval.” It is: the platform should show the exact scope, make it easy to revoke, and never rely on repetition to win consent. Until Muse exposes that ledger, treat the grant as a convenience whose boundary remains partly unknown.
Verification note: the research read public documentation and web text on September 17, 2026. It did not live-test each product. Undocumented behavior is labeled as such.
This is part of Tygart Media’s AI Search Intelligence series, where we analyze real data from our own infrastructure to document how AI search engines discover, crawl, and cite publisher content.
Here is the uncomfortable truth that every publisher needs to confront: Google Analytics 4 cannot see AI crawler traffic. Not partially. Not approximately. It misses 100% of it.
GA4 depends on JavaScript execution inside a browser. AI crawlers — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot — do not run JavaScript. They request your HTML, parse it, and leave. As far as GA4 is concerned, they were never there.
That means if you are making content strategy decisions based exclusively on GA4, you are making decisions with a growing blind spot. When we analyzed our own server logs for a 48-hour window in June 2026, we found 6,805 AI crawler hits compared to 4,897 traditional search engine crawler hits — AI crawlers generated 39% more traffic than Googlebot, Bingbot, and every other traditional crawler combined (Tygart Media server log analysis, June 2026).
This article walks through exactly what server logs reveal that analytics tools miss, provides the specific user agent strings you need to monitor, and gives you a practical framework for setting up your own AI crawler tracking.
Why GA4 Is Structurally Blind to AI Search Traffic
GA4 is structurally blind to AI search traffic.
This is not a configuration problem. You cannot fix it with a tag update or a GTM trigger. The architecture of client-side analytics makes it fundamentally incompatible with bot traffic measurement.
How GA4 Tracking Works (And Where It Fails)
GA4 tracking follows a specific sequence: a user loads a page in a browser, the browser executes the gtag.js JavaScript snippet, that script fires an HTTP request to Google’s measurement endpoint, and GA4 records the session. Every step in this chain requires a JavaScript-capable browser environment.
AI crawlers skip all of it. When GPTBot requests a page from your server, it receives the raw HTML response, extracts the content it needs, and moves on. No JavaScript execution. No measurement ping. No GA4 session. The request exists only in your server’s access log.
We documented this gap extensively in our analysis of the Google Search Console indexing paradox, where pages with declining GA4 traffic were simultaneously receiving increasing AI crawler attention — a pattern completely invisible without server log analysis.
The Scale of What You Are Missing
To quantify what GA4 misses, we pulled raw access logs from our Nginx server for a 48-hour window in June 2026 and categorized every request by user agent classification.
The breakdown (Tygart Media server log analysis, June 2026):
AI crawler requests: 6,805 total
Traditional search crawler requests: 4,897 total
Difference: AI crawlers generated 39% more server requests than traditional crawlers
None of those 6,805 AI crawler requests appeared in GA4. If we had relied solely on Google Analytics to understand how machines interact with our content, we would have missed the majority of non-human traffic entirely.
As we explored in our research on how websites are now read by AI more than humans, this pattern is not unique to our site — it reflects a structural shift in how content gets consumed.
AI Crawler User Agents: The Complete Reference for June 2026
AI crawler user-agent reference — know who is reading.
Definition: An AI crawler user agent is the identification string sent in the HTTP request header by an artificial intelligence company’s web crawler when it accesses a webpage. These strings identify the crawler’s operator, version, and purpose, and they are the primary mechanism publishers use to track, allow, or block AI bot access in server logs and robots.txt files.
Before you can monitor AI crawler traffic, you need to know exactly what to look for. Here are the verified user agent strings we extracted from our server logs, confirmed active as of June 2026.
OpenAI Crawler Family
OpenAI operates three distinct crawlers, each with a different purpose:
GPTBot (Training and Retrieval Crawler)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot
GPTBot performs large-scale structural crawls for model training data and retrieval-augmented generation indexing. Our logs recorded a single GPTBot session executing 1,123 requests in one hour, systematically mapping site architecture, internal link relationships, and content hierarchy (Tygart Media server log analysis, June 2026). This is not page-by-page fetching — it is comprehensive site mapping.
OAI-SearchBot (ChatGPT Search Citation Crawler)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot)
OAI-SearchBot is the real-time retrieval crawler that fetches pages when ChatGPT Search needs to cite a source. As we documented in our guide to getting cited in ChatGPT Search in 2026, this crawler’s access pattern correlates directly with citation inclusion. If OAI-SearchBot cannot reach your page, ChatGPT Search cannot cite it.
ChatGPT-User (Live Conversation Fetches)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
ChatGPT-User represents real-time fetches triggered by actual ChatGPT users sharing URLs or requesting content analysis during conversations. This was our highest-volume AI crawler: 3,404 hits in the 48-hour analysis window (Tygart Media server log analysis, June 2026). Each of these hits represents a real person asking ChatGPT about content on our site.
Other Major AI Crawlers
Beyond OpenAI, monitor for these active AI crawlers:
ClaudeBot — Anthropic’s web crawler for Claude’s training and retrieval
PerplexityBot — Perplexity AI’s search and citation crawler
Bytespider — ByteDance’s crawler used for AI training data
Applebot-Extended — Apple’s crawler associated with Apple Intelligence features
Google-Extended — Google’s AI-specific crawler separate from Googlebot
Amazonbot — Amazon’s crawler linked to Alexa and AI assistant features
Each of these should be tracked separately in your log analysis. As our Platform-Specific AI Optimization (PSAO) framework details, different AI platforms have different crawl behaviors, indexing requirements, and citation patterns.
What the 48-Hour Server Log Analysis Revealed
Raw numbers tell part of the story. Crawl behavior patterns tell the rest. Here is what we observed when we dissected the 48-hour log window at the request level.
ChatGPT-User: The Highest-Volume Signal
With 3,404 hits in 48 hours, ChatGPT-User was the single most active AI crawler on our site during the analysis window (Tygart Media server log analysis, June 2026). This matters because every ChatGPT-User request represents a real person interacting with your content through ChatGPT.
The access pattern was distributed across the full 48-hour window with no single burst — consistent with organic user behavior rather than scheduled crawling. Pages accessed by ChatGPT-User skewed heavily toward our most-cited content, particularly the 98,800 AI citations research and our analysis of how AI engines cite content.
GPTBot: The Structural Mapper
GPTBot’s 1,123-request burst in a single hour stands out as the most aggressive crawl pattern we observed (Tygart Media server log analysis, June 2026). This was not random page fetching. The request sequence revealed systematic behavior:
Entry via sitemap.xml — GPTBot started by parsing our XML sitemap
Category page traversal — It crawled category archives to understand content taxonomy
Internal link following — It followed internal links from high-authority pages outward
Content page fetching — Individual articles were fetched in clusters organized by topic
This pattern is consistent with a retrieval-augmented generation (RAG) indexing crawl, where the goal is not just to read content but to build a structured map of how content relates to other content on the site. Publishers who invest in structured llms.txt files paired with robots.txt are effectively giving GPTBot a guided tour rather than letting it map the site on its own.
Bingbot and the 4-Hour IndexNow Gap
While Bingbot is a traditional crawler, its behavior has direct implications for AI search visibility. Our logs revealed a consistent 4-hour gap between publishing a new post (with an IndexNow ping) and Bingbot’s first crawl of that URL (Tygart Media server log analysis, June 2026).
This 4-hour lag matters because Bing’s index is the foundation for two major AI citation systems:
ChatGPT Search — OAI-SearchBot relies on Bing’s index to identify candidate pages for citation retrieval
A 4-hour indexing lag means your new content is invisible to both Copilot and ChatGPT Search for at least that window. For time-sensitive content, this gap represents a competitive disadvantage.
How to Set Up Your Own AI Crawler Monitoring
Set up your own AI crawler monitoring.
You do not need expensive tools to start tracking AI crawlers. Here is a practical step-by-step framework using standard server infrastructure.
Step 1: Locate Your Raw Access Logs
Your server access logs are the source of truth. Depending on your hosting setup:
Nginx: Default location is /var/log/nginx/access.log
Apache: Default location is /var/log/apache2/access.log or /var/log/httpd/access_log
Managed WordPress hosting (Cloudways, Kinsta, WP Engine): Access logs are typically available in the hosting dashboard under server logs or SFTP access
Shared hosting (SiteGround, Bluehost): Check cPanel > Metrics > Raw Access or request log access from support
If your host does not provide raw access logs, that is a serious limitation for AI search optimization. Consider this a factor in future hosting decisions.
Step 2: Filter for AI Crawler User Agents
Once you have access to raw logs, use grep (or your preferred log analysis tool) to isolate AI crawler requests. Here is a basic command set:
# Count all AI crawler hits in a log file
grep -c -E "GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|PerplexityBot|Bytespider|Applebot-Extended|Google-Extended" access.log
# Break down by individual crawler
for bot in GPTBot OAI-SearchBot ChatGPT-User ClaudeBot PerplexityBot Bytespider; do
echo "$bot: $(grep -c "$bot" access.log)"
done
# Show which URLs each crawler is accessing
grep "GPTBot" access.log | awk '{print $7}' | sort | uniq -c | sort -rn | head -20
Step 3: Build a Recurring Monitoring Script
For ongoing tracking, create a cron job that generates a daily AI crawler report:
The real value emerges when you correlate AI crawler data with content outcomes. Track these relationships:
GPTBot crawl frequency → Citation appearances. Pages that GPTBot crawls repeatedly tend to surface in ChatGPT responses more frequently. We verified this pattern in our investigation of whether anything actually fetches your llms.txt file.
OAI-SearchBot access → ChatGPT Search citations. OAI-SearchBot visits are a leading indicator that your content is being evaluated for citation in ChatGPT Search results.
ChatGPT-User volume → Content demand signal. High ChatGPT-User traffic to specific pages indicates those topics are actively being discussed by ChatGPT users — a demand signal invisible in GA4.
Step 5: Set Up Real-Time Alerts
For publishers who need immediate visibility into AI crawler behavior, configure real-time log monitoring:
# Real-time AI crawler monitoring with tail
tail -f /var/log/nginx/access.log | grep --line-buffered -E "GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|PerplexityBot"
For production environments, tools like GoAccess, Datadog, or a custom ELK Stack (Elasticsearch, Logstash, Kibana) configuration can provide dashboards with AI crawler metrics alongside traditional analytics.
What Server Logs Reveal That No Analytics Tool Can Show
Beyond raw hit counts, server log analysis exposes behavioral patterns that inform content strategy decisions.
Crawl Depth and Site Architecture Signals
Traditional analytics shows you which pages humans visit. Server logs show you which pages machines prioritize. In our 48-hour analysis, AI crawlers accessed pages up to 7 levels deep in our site architecture — well beyond what most human visitors reach. This indicates that AI crawlers are evaluating your entire content graph, not just your homepage and top-ranking pages.
This has direct implications for internal linking strategy. Content buried deep in your architecture that humans rarely find may still be actively indexed by AI crawlers and surfaced in AI-generated responses. Our work on the AI citation economy explores why being cited by AI systems may ultimately deliver more value than traditional click-through traffic.
Crawl Frequency as a Content Quality Signal
Some pages on our site are crawled by AI bots multiple times per day. Others are crawled once and never revisited. Tracking crawl frequency over time reveals which content AI systems consider worth re-indexing — a signal that correlates with citation likelihood.
Pages that received repeat GPTBot and OAI-SearchBot visits in our analysis shared common characteristics:
Original data or research (not aggregated from other sources)
Clear entity definitions and structured formatting
Recent publication or update dates
Strong internal link support from related content
Response Code Analysis: Are AI Crawlers Hitting Errors?
Server logs include HTTP response codes for every request. Filter AI crawler requests by response code to identify problems:
200 (OK): Crawler successfully fetched the page — this is what you want
301/302 (Redirect): Crawler hit a redirect chain — check that critical content resolves cleanly
403 (Forbidden): Your server or WAF is blocking the crawler — this may be intentional (robots.txt block) or accidental (overly aggressive security rules)
404 (Not Found): Crawler tried to access a URL that does not exist — often caused by stale sitemap entries or broken internal links
429 (Too Many Requests): Your rate limiting is throttling the crawler — may reduce indexing completeness
503 (Service Unavailable): Server could not handle the crawler’s request volume — a hosting capacity issue
We found that 3.2% of AI crawler requests in our 48-hour window received non-200 responses, primarily 301 redirects from URL structure changes (Tygart Media server log analysis, June 2026). Each non-200 response is a potential missed indexing opportunity.
Building a Server Log Analysis Workflow for AI Search
Here is the complete monitoring workflow we use at Tygart Media, adapted for any publisher running WordPress or a similar CMS.
Daily Monitoring Checklist
Run the AI crawler count script — Track total hits by crawler to identify volume trends
Check for new user agent strings — AI companies launch new crawlers regularly; grep for unrecognized bot patterns
Review top-accessed URLs — Identify which content AI systems are prioritizing today
Monitor response codes — Flag any increase in 403, 404, or 429 responses to AI crawlers
Cross-reference with publication schedule — Track the time gap between publishing and first AI crawler access
Weekly Analysis Framework
Compare AI crawler volume week-over-week — Is AI crawl activity increasing, stable, or declining?
Identify content that stopped getting crawled — Pages that fall off AI crawler radar may be losing citation eligibility
Correlate crawl patterns with known AI search updates — AI platforms update their retrieval systems frequently
Update your llms.txt and sitemap — Based on what AI crawlers are actually accessing versus what you want them to prioritize
Tools for Scaling Server Log Analysis
For publishers managing multiple sites or high-traffic properties, manual grep commands do not scale. Consider these tools:
GoAccess — Open-source real-time log analyzer with terminal and HTML dashboard output. Supports custom log formats and can filter by user agent.
Screaming Frog Log File Analyser — Desktop application specifically designed for SEO log analysis. Supports AI bot filtering and integrates with Google Search Console data.
ELK Stack (Elasticsearch, Logstash, Kibana) — Enterprise-grade log analysis pipeline. Best for publishers who need custom dashboards and real-time alerting.
Datadog / New Relic — Cloud monitoring platforms with log analysis capabilities. Good for teams already using these tools for infrastructure monitoring.
Custom Python/bash scripts — For publishers with technical resources, custom scripts offer the most flexibility for AI-specific analysis.
The Implications: What This Data Means for Content Strategy
Server log analysis is not just a technical exercise. The data it produces should directly inform editorial and SEO decisions.
Content That AI Crawlers Ignore Is Content That AI Will Not Cite
If a page on your site receives zero AI crawler visits over a 30-day window, that page is effectively invisible to AI search systems. It will not be cited by ChatGPT, it will not appear in Copilot responses, and it will not surface in Perplexity answers.
This is a different problem than low Google rankings. A page can rank well in traditional search while being completely absent from AI search — and vice versa. As we documented in our research showing Claude citing articles 16,500 times while Copilot cited roofing content zero times, AI platforms have fundamentally different content preferences than traditional search engines.
AI Crawler Volume Is a Leading Indicator
Traditional analytics are lagging indicators — they tell you what happened after traffic arrived. AI crawler activity is a leading indicator — it tells you what content AI systems are evaluating for future citation. Increasing AI crawl frequency on a specific page or topic cluster often precedes increased citation rates by days or weeks.
Server Logs Validate (or Invalidate) Your Optimization Efforts
If you have implemented llms.txt files, updated your robots.txt, or restructured content for AI search optimization, server logs are the only way to verify that these changes are working. Analytics tools cannot confirm that GPTBot is crawling your llms.txt file. Only your access logs can.
No. GA4 relies on JavaScript execution in a browser environment. AI crawlers like GPTBot, OAI-SearchBot, and ChatGPT-User do not execute JavaScript, so they are completely invisible in GA4. Server log analysis is the only reliable method to monitor AI crawler activity on your site.
What are the main AI crawler user agents to monitor in 2026?
The primary AI crawler user agents to monitor are GPTBot (OpenAI’s training and retrieval crawler), OAI-SearchBot (ChatGPT Search’s real-time citation crawler), ChatGPT-User (live user-initiated fetches from ChatGPT conversations), ClaudeBot (Anthropic’s crawler), Bytespider (ByteDance/TikTok), and PerplexityBot (Perplexity AI’s search crawler).
How many AI crawler requests does a typical publisher site receive?
Volume varies by site authority and content type. Tygart Media’s server log analysis from June 2026 recorded 6,805 AI crawler hits compared to 4,897 traditional search engine crawler hits in a 48-hour window — meaning AI crawlers generated 39% more traffic than traditional crawlers during that period.
What is GPTBot’s crawl behavior pattern?
GPTBot performs intensive structural crawls. Tygart Media server log analysis from June 2026 documented a single GPTBot session executing 1,123 requests within one hour, systematically mapping site architecture, internal links, and content relationships rather than fetching individual pages.
How quickly does Bingbot index new content published via IndexNow?
Based on Tygart Media server log analysis from June 2026, Bingbot showed a consistent 4-hour gap between content publication via IndexNow ping and first crawl of the new URL. This lag is significant because Bing’s index feeds both Microsoft Copilot citations and ChatGPT Search results through OAI-SearchBot.
What Comes Next: From Monitoring to Optimization
Setting up AI crawler monitoring through server logs is the foundation. The next step is using that data to optimize your content specifically for AI search visibility. Key areas to explore:
Robots.txt and llms.txt alignment — Ensure your crawl directives match your citation goals
Content structure optimization — Format content in ways that AI crawlers can efficiently parse and cite
Publication timing — Account for the 4-hour Bingbot indexing gap when publishing time-sensitive content
Cross-platform monitoring — Track how different AI crawlers prioritize different content types
The publishers who will win in AI search are the ones who understand exactly how AI systems interact with their content — and that understanding starts with server logs, not analytics dashboards.
All data referenced in this article is sourced from Tygart Media server log analysis, June 2026. For methodology details and access to our broader AI Search Intelligence research, explore the full series on tygartmedia.com.
Direct Answer (November 13, 2026): Anthropic’s current coding and reasoning lineup is Fable 5.2 (claude-fable-5-2, $8/$40), Opus 5.5 (claude-opus-5-5, $4/$20), Sonnet 5.5 (claude-sonnet-5-5, $2/$10), and Haiku 5.5 (claude-haiku-5-5, $0.10/$0.50 ≤100K) — all with 1M context and 128K max output. The primary-source leaderboard below preserves our verified June 13, 2026 cross-vendor benchmark audit (Fable 5, Opus 4.8, GPT-5.5, Gemini 3.1 Pro) without re-attributing historical scores to newer releases.
As of June 13, 2026, the four models most often compared for coding work are Claude Fable 5 and Claude Opus 4.8 from Anthropic, GPT-5.5 from OpenAI, and Gemini 3.1 Pro from Google. This page is a leaderboard built on one rule: every score below is taken from a vendor’s own page or the benchmark’s official model card that we fetched on the verification date, or it is marked as not published. Several vendors publish their benchmark tables as images rather than machine-readable text; where we could not read an official figure directly, we list the metric as not machine-verifiable and link to the source document instead of estimating. The result is a smaller table than most roundups, but every number in it is one you can click through and check.
November 2026 lineup update: Since those June 13 scores were verified, Anthropic’s lineup has moved to Fable 5.2 ($8/$40), Opus 5.5 ($4/$20), Sonnet 5.5 ($2/$10), and Haiku 5.5 ($0.10/$0.50 ≤100K; $0.50/$2.50 >100K), superseding Fable 5.1, Fable 5, Opus 4.8, and Haiku 4.5. The historical benchmark scores below remain labeled under their June 2026 models and have not been re-attributed.
Models and pricing (specs verified June 13, 2026)
Models compared — verified specs without sticky dollars.
These columns are confirmed from each vendor’s official model documentation. Claude prices, context windows, and cutoffs come from Anthropic’s models overview and the AWS Bedrock model card; GPT-5.5 from OpenAI’s developer docs; Gemini 3.1 Pro from Google’s DeepMind model card and the Gemini API pricing page.
Model
API ID
Input / Output (per Mtok)
Context
Max output
Knowledge cutoff
Claude Fable 5
claude-fable-5
$10 / $50
1M
128K
Not stated on overview*
Claude Opus 4.8
claude-opus-4-8
$5 / $25
1M
128K
Jan 2026
GPT-5.5
gpt-5.5
$5 / $30
1,050,000
128K
Dec 1, 2025
Gemini 3.1 Pro
gemini-3.1-pro-preview
$2 / $12 (≤200K)**
1M
64K
Not stated on model card
*Anthropic’s models overview lists Fable 5’s specs and price but does not publish a knowledge-cutoff date for it in the table we fetched. **Gemini 3.1 Pro uses tiered pricing: $2 / $12 per Mtok for prompts up to 200K tokens, rising to $4 / $18 for prompts above 200K tokens (Google AI pricing page). GPT-5.5 pricing rises to 2x input / 1.5x output above 272K input tokens (OpenAI developer docs). Claude Opus 4.8 (legacy — still listed) offers an optional fast mode at $10 / $50 per Mtok (Anthropic).
Coding benchmark scores (primary-source only, June 2026 models)
Coding benchmark scores — primary-source only.
Each cell is either a figure we read directly from a primary source on June 13, 2026, or marked “not machine-verifiable” with the source you should consult. A blank-equivalent entry never means zero — it means the official figure was not available in readable form during verification. Note the harness and version differences called out in the footnotes: they make cross-vendor cells not strictly comparable.
Benchmark
Claude Fable 5
Claude Opus 4.8
GPT-5.5
Gemini 3.1 Pro
SWE-bench Verified
Not machine-verifiable (see system card)
Not machine-verifiable (see system card)
Not published in retrievable primary source
80.6%
SWE-bench Pro (Public)
Not machine-verifiable (see system card)
Not machine-verifiable (see system card)
Not published in retrievable primary source
54.2%
Terminal-Bench
Not machine-verifiable (see system card)
Not machine-verifiable (see system card)
83.4% (v2.1, Codex CLI harness)â€
68.5% (v2.0, Terminus-2 harness)
LiveCodeBench Pro
Not published in retrievable primary source
Not published in retrievable primary source
Not published in retrievable primary source
2887 Elo
†GPT-5.5’s Terminal-Bench 2.1 figure of 83.4% is the score Anthropic attributes to GPT-5.5 “with the Codex CLI harness” in a footnote on its Claude Opus 4.8 announcement page. It is a competitor-reported comparison, not a number we read from OpenAI directly. Google reports Gemini 3.1 Pro on Terminal-Bench 2.0 under the Terminus-2 harness (68.5%); because the version and harness differ, the Gemini and GPT-5.5 Terminal-Bench cells are not directly comparable. Gemini’s SWE-bench Verified (80.6%), SWE-bench Pro Public (54.2%), and LiveCodeBench Pro (2887 Elo) are single-attempt figures from Google’s official Gemini 3.1 Pro model card.
What we could not verify from a primary source
Anthropic publishes its coding comparison tables for Claude Opus 4.8 and Claude Fable 5 as images inside its announcement pages, and the full Claude Opus 4.8 System Card PDF exceeded our fetch size limit, so we could not machine-read those percentages on the verification date. OpenAI’s GPT-5.5 announcement page returned an access error to our fetcher, and its developer-docs model page lists specs and pricing but no benchmark scores. We have therefore left Claude’s and GPT-5.5’s SWE-bench figures out of the table rather than reproduce numbers we could not confirm at the source. For those figures, consult the primary documents linked in our source list: the Claude Opus 4.8 System Card, the Claude Fable 5 and Mythos 5 announcement, and OpenAI’s GPT-5.5 page. If you are choosing a model today, the verified spec table above (price, context, output, cutoff) is the part you can rely on without caveat.
How to read a coding leaderboard
How to read a coding leaderboard.
Three cautions apply to any 2026 coding comparison. First, harness matters: the same model scores differently on Terminal-Bench depending on whether it runs under Terminus-2, a Codex CLI scaffold, or a vendor’s internal agent, which is why we annotate every Terminal-Bench cell. Second, version matters: “Terminal-Bench 2.0” and “Terminal-Bench 2.1” are different test sets, and “SWE-bench Pro” public and full splits differ — a single percentage with no version is close to meaningless. Third, a headline score is one slice of behavior; long-horizon agentic coding, tool-call reliability, and context handling over a long session often decide real-world usefulness more than a single pass rate. Treat the verified cells here as a starting point, then test the shortlist on your own repository.
Which model has the highest published coding benchmark score in June 2026?
We cannot crown a single winner from primary sources alone, because Anthropic and OpenAI publish their coding scores in formats we could not machine-verify on June 13, 2026. From figures we could read directly, Google’s Gemini 3.1 Pro model card reports 80.6% on SWE-bench Verified and 54.2% on SWE-bench Pro (Public). Anthropic’s and OpenAI’s comparable figures are in their system cards and announcement pages, which we link in the sources; we did not reproduce them here because they were not readable at the source during verification.
What does Claude Fable 5 cost, and how is it different from Opus 4.8 (legacy — still listed)?
Claude Fable 5 (claude-fable-5) is priced at $10 per million input tokens and $50 per million output tokens, with a 1M-token context window and up to 128K output tokens (Anthropic models overview). Claude Opus 4.8 (legacy — still listed) (claude-opus-4-8) is the Opus-tier flagship at $5 / $25 per Mtok, also 1M context and 128K output, with a January 2026 knowledge cutoff. Fable 5 is Anthropic’s most capable widely released model; Opus 4.8 (legacy — still listed) is the lower-priced model most teams will use for everyday agentic coding.
Lineup currency (November 13, 2026): Current API list: Fable 5.2 $8/$40, Opus 5.5 $4/$20, Sonnet 5.5 $2/$10, Haiku 5.5 $0.10/$0.50 (≤100K). Legacy (still listed on Anthropic’s card): Fable 5.1 $10/$50, Haiku 4.5 $1/$5, Opus 4.8 $5/$25, Sonnet 4.6 $3/$15.
Why are some benchmark cells marked “not machine-verifiable” instead of showing a number?
Because this page only prints scores we could confirm from a primary source on the verification date. Several vendors render their benchmark tables as images, and one large system-card PDF exceeded our fetch limit, so the underlying percentages were not readable to us. Rather than copy figures from third-party trackers, we mark the cell and point you to the official document. It keeps the leaderboard honest at the cost of being shorter.
How do the context windows compare?
Claude Fable 5, Claude Opus 4.8, and Gemini 3.1 Pro each offer a 1M-token context window; GPT-5.5 offers 1,050,000 tokens. Maximum output is 128K tokens for Claude Fable 5, Claude Opus 4.8, and GPT-5.5, and 64K tokens for Gemini 3.1 Pro. Note that Claude Opus 4.8’s context window is 200K on Microsoft Foundry specifically, per Anthropic’s documentation.
Is Terminal-Bench comparable across these models?
Not cell-for-cell. Google reports Gemini 3.1 Pro on Terminal-Bench 2.0 under the Terminus-2 harness (68.5%), while the GPT-5.5 figure we show (83.4%) is Terminal-Bench 2.1 under a Codex CLI harness, as attributed by Anthropic. Different versions and different harnesses mean the two numbers should not be read as a head-to-head result.