Rapid Rise of AI Bot Traffic
According to Tollbit, the ratio of AI bot visits to human visits jumped from 1:200 at the start of 2025 to 1:31 by the end of the year, indicating that an AI bot now arrives for every 31 human page views.
Human Visits Decline
During the same period, human traffic fell roughly 5% between Q3 and Q4 2025 as users increasingly interact directly with AI assistants.
Changing Search Behaviors
A survey cited in the report found that 37% of active AI users now begin their searches with generative AI tools such as ChatGPT or Gemini instead of traditional search engines.
Robots.txt Is Being Ignored
Robots.txt directives, which rely on voluntary compliance, were ignored on average 30% of the time and up to 42% of the time by the ChatGPT‑User bot, rendering the protocol effectively obsolete.
Impact on Publisher Click‑Through Rates
Sites without direct AI licensing deals saw click‑through rates (CTR) drop about three‑fold between Q2 and Q4 2025. Even publishers with AI licensing agreements experienced significant CTR declines.
Calls for Regulation
Tollbit urges regulators to define acceptable AI crawling patterns and protect intellectual property as AI traffic becomes the dominant force on the web.
Preparing for an AI‑Driven Web
Publishers should consider strategies such as:
- Negotiating clear AI licensing terms.
- Implementing server‑side detection and tailored content for bot readers.
- Monitoring traffic metrics to differentiate between human and AI activity.
- Advocating for industry standards that make bot behavior transparent.