When Google answered in AI Mode, people clicked on far fewer websites
Google now answers many searches itself: a summary at the top of the results, or AI Mode, where the whole page is a written answer. Someone searching for a treatment in their town can get a reply that names a few clinics without opening any website. I wanted to know whether anyone has measured what this does to clicks. One experiment posted this summer did, with real people on their own computers. It was not about clinics, and this article says what that changes.
What the experiment did
Researchers at the University of Pennsylvania and Northeastern University recruited 1,444 adults in the United States in March 2026, all people who use Chrome and search with Google.1 Each installed a browser extension that recorded their searches and clicks during their normal browsing. For three days nothing changed. Then each person was assigned at random to one of three versions of Google for seven days:
- Google without AI: the AI summaries were hidden and AI Mode was turned off;
- Google as it is: nothing changed;
- AI Mode only: every search was sent to AI Mode.
The study and its analysis were registered in advance. 1,100 participants searched at least once during the seven days, and the behaviour results are measured on them.
What it found
- 18.8 ptslower click-through rate to outside websites for people assigned to AI Mode
- 8.8 ptshigher click-through rate when the AI summaries were hidden
- 0.6%of searches used AI Mode before the experiment, by people’s own choice
People assigned to AI Mode clicked through to other websites much less often than people using Google as it is. They also searched less often per day, and they reported less trust in the information they found on Google. Fewer clicks did not come with a better experience: they rated AI Mode as less useful and less satisfying.
Hiding the AI summaries went the other way: more clicks to websites. That estimate needs care. During the study Google changed the code of its summaries, which broke the extension, and only about half of the summaries were actually hidden. The authors used a statistical correction they had registered in advance for this case, and it rests on assumptions they spell out.
An earlier observational study points in the same direction. In March 2025 the Pew Research Center looked at the browsing of 900 American adults.2 When a search showed an AI summary, people clicked on a regular result in 8% of visits, against 15% when there was no summary. They clicked on a link inside the summary in 1% of visits. Observational means nobody assigned who saw a summary, so this shows a difference, not its cause. The experiment is what adds the cause.
What this experiment does not show
- It is a preprint, not yet reviewed by other researchers. The version I read is marked as a draft.
- AI Mode was forced on every search. Almost nobody used it by choice at the start, and the authors write that people who adopt it gradually may behave differently.
- Seven days only. People may get used to it, or not.
- All kinds of searches, not searches for a clinic or a local service. The authors ask for studies on specific areas and name health among them.
- The participants were younger, more educated and more left leaning than the American population.
- It measures clicks, not appointments, and it says nothing about which businesses the answer names.
The study was funded by the National Science Foundation, and the authors declare no competing interests.
What decides who gets named
If fewer people click, the businesses named in the answer get more of the attention that is left. I found no experiment on how an AI answer chooses between clinics. The closest is SAGEO Arena, a study presented at KDD 2026, a peer reviewed computer science conference.3 Researchers in Seoul took 171,003 real web pages returned by Google for 2,700 questions and rebuilt the steps of an AI search engine: find the pages, rank them, write an answer that cites some of them. Then they rewrote pages in different ways and watched whether each one rose or fell.
- Rewriting only the body text with an AI tool made pages slightly harder to find and slightly less often cited, on average.
- Improving the title, the description and the structured data that search engines read made pages 22% more likely to be found in the first step.
- Pages ranked higher when the answer came early, and dropped when a rewrite pushed the answer further down, even with the answer still on the page.
This is a search engine built by the researchers, not Google. None of the nine kinds of questions was about a local business, and in the shopping questions every rewriting method lowered the chance of being cited. It shows what such a system reads, not what it brings a clinic.
What I take from this for a clinic
- I found no study that measures what AI Mode does to a clinic’s bookings. The experiment measured clicks across all kinds of searches.
- When Google answers in AI Mode, far fewer people click through to websites. That was measured with random assignment, on real browsing, in 2026.
- So whether the answer names your clinic matters more than it used to. That part is reasoning from the experiment, not something it measured.
- In an audit I search for a treatment in the clinic’s town in AI Mode, three times, and write down which clinics the answer names. If it names others every time and never yours, I say so, with the screenshots. What I do not do is promise that a change to the site will get a clinic named. Nobody has measured that.
Sources
Each source was opened and read in full before this page was written.
- Wang, S. T., Gleason, J., Bart, Y., Wilson, C., & Metaxa, D. (2026). AI in search reduces publisher referrals without improving user experience: Experimental evidence. arXiv:2608.18352, preprint. arxiv.org/abs/2608.18352 Design: preregistered randomized field experiment on Google Search through a browser extension, three days of baseline and seven days of treatment. 1,444 US adults enrolled in March 2026, 1,100 in the behaviour analysis, 956 in the final survey. Not peer reviewed.
- Chapekis, A., & Lieb, A. (2025, July 22). Google users are less likely to click on links when an AI summary appears in the results. Pew Research Center. pewresearch.org Design: observational. Browsing data of 900 US adults from the KnowledgePanel Digital panel, 68,879 unique Google searches from March 2025, 12,593 of them with an AI summary.
- Kim, S., Jeong, W., Kim, S., Lee, S., & Lee, D. (2026). SAGEO Arena: A realistic environment for evaluating search-augmented generative engine optimization. Proceedings of KDD 2026. doi.org/10.1145/3770855.3818146, also arxiv.org/abs/2602.12187 Design: simulated AI search pipeline over 171,003 real web pages for 2,700 questions from nine datasets; pages rewritten with ten methods and ranked again at each step. Peer reviewed conference paper.