Web Bot Auth(webbotauth)

• IETF123: Mon 21 Jul 2025 17:00 - Auditorio
• BoF request
• Of interest because: potentially more control by server operators on what bots are given access to their data.
• keywords: AI, search

Web bots crawl the world wilde web constantly and servers of webcontent and are interested in identifying robotic web agents using cryptographic mechanism to identify robots. Which will go beyond heuristics based on their source IP address, their names - as queried in the reverse DNS, or based on the user-agent claims made by the bots in the header.

The protagonists are working on the mailing list to define a draft charter.