Reading view

Web Bot Auth, Google’s new experimental method to validate authentic bots

Google is trying a new method of bot authentication named Web Bot Auth. Google posted a new help document that explains that Web Bot Auth is a “new cryptographic protocol that helps websites to validate that bots are authentic.”

The goal of Web Bot Auth is to help you automate the process of authenticating which AI Agent bots are authentic and which are fraud.

Limited test. Google said the search compan is “testing the protocol with some AI agents hosted on Google infrastructure.” Not all Google user agents are using Web Bot Auth and Google is not yet signing every request of agents using the protocol.

Thus Google recommends that in addition to Web Bot Auth you continue relying on IP addresses, reverse DNS, and user-agent strings as Google gradually rolls out signed traffic.

What is Web Bot Auth. Google defined Web Bot Auth as “Web Bot Auth is an experimental cryptographic protocol used to authenticate requests sent by bots. Instead of relying solely on self-reported headers and IP addresses, Web Bot Auth allows agents to cryptographically sign their requests.”

Web Bot Auth can bring the following benefits according to Google:

  • Future-proofing: Help establish a web where agent providers and websites can build mutual trust and make informed access decisions.
  • Cryptographic certainty: Move beyond easily spoofed headers to a verified identity and decouple agent identity from IP addresses.
  • Better observability: Gain clearer insights into how agents interact with your content.

Why we care. As AI Agents become more and more common across the web, managing which Agents can access your site and web pages may become more and more of a challenge. This new method of authentication may help you allow authentic AI Agents and block the inauthentic AI Agents.

Again, this is an “experimental” feature right now, so keep track of its progress.

Google fixes Search Console’s year-long data logging issue – well, kind of…

Screenshot of Google Search Console

Google said it has “resolved” an issue with logging data within Google Search Console reporting. The logging issue happened between May 13, 2025 through April 27, 2026, about 50 weeks. The resolution did not fix the past data, but it did fix the issue going forward.

What Google said. Here is what Google posted:

“A logging error prevented Search Console from accurately reporting impressions from May 13, 2025 until April 27, 2026. This issue has been resolved. As a result, you may notice a decrease in impressions in the Search Console Performance report. Only impressions and related metrics – CTR and average position – were affected; clicks were not affected by the error, and this issue affected data logging only.”

What was fixed. Just to be clear, Google has not fixed the data from May 13, 2025 through April 27, 2026 but just fixed the data going forward. So keep this in mind when reviewing the data in that date range.

John Mueller from Google confirmed on Bluesky that this is only fixed going forward and the old data will not be fixed.

Why we care. When reviewing your Search Console data, please note that for about 50 weeks, almost a year, the reports may be off and you may see a decrease in impressions, and thus click-through rate and average position data are also impacted.

Ask.com shuts down after over 25 years

Ask.com, formerly Ask Jeeves, which launched 29 years ago on June 3, 1996, before Google launched, shut down on May 1, 2026.

Ask.com now has a turn down page that reads:

Every great search
must come to an end.
As IAC continues to sharpen its focus, we have made the decision to discontinue our search business, which includes Ask.com. After 25 years of answering the world’s questions, Ask.com officially closed on May 1, 2026.

“To the millions who asked…”
We are deeply grateful to the brilliant engineers, designers, and teams who built and supported Ask over the decades. And to you—the millions of users who turned to us for answers in a rapidly changing world—thank you for your endless curiosity, your loyalty, and your trust.

Jeeves’ spirit endures.

Ask.com has been known as an answer engine, the Jeeves butler was who you spoke to in the early days. With AI and all these new answer engines, Ask.com could have deployed its own unique taste for its answer engine. But I guess with all the competition and the market being harder, IAC, Ask.com’s parent company, decided to turn it down.

Ask.com will always have a place in the search marketing industry and Ask, including Jeeves, will be missed.

Google Preferred Sources now works for all languages

Google’s Preferred Sources now supports all languages, not just the English language. “Preferred Sources is now rolling out globally in all supported languages,” Google wrote on its blog this morning.

“This feature gives you more control over the news you see on Search by letting you choose the outlets and sites you want to appear more often in Top Stories,” Google added.

In December, Google rolled out preferred sources globally but it only supported English. Now it supports all languages globally as well.

Stats. Google added some interesting data including:

  • “Readers are twice as likely to click through to a site after marking it as a Preferred Source”
  • “People have already selected over 200,000 unique sites — from niche local blogs to global news desks”

Preferred Sources. Preferred Sources let searchers star publications in the Top Stories section of Google Search, and Google uses that signal to show more stories from those starred outlets. The feature entered beta in June, rolled out in the U.S. and India in August, and is now expanding globally.

How it works. You click the star icon to the right of the Top Stories header in search results. After that, you can choose your preferred sources – assuming the site is publishing fresh content.

Google will then start to show you more of the latest updates from your selected sites in Top Stories “when they have new articles or posts that are relevant to your search,” Google added.

More details can be found over here.

Why we care. Traffic from Google Search is hard and if you can get your readers, loyal readers, to make your site a preferred source, that can help. Google said those users are twice as likely to click, which can help drive more traffic.

So add the preferred source icon to your site and encourage users to sign up. You can make Search Engine Land a preferred source by clicking here.

❌