← All posts
By Naiw 2026-03-31 5 min read

The Web Is Forking

AI agent traffic surged 7,851% in 2025. One internet is for humans, another is forming for machines. Most newsletter publishers aren't building for the side that's growing.

Two internets now exist. You just can't see the second one.

The first is the one you're reading right now. HTML pages designed for human eyes, styled with CSS, loaded with JavaScript, wrapped in cookie banners and newsletter popups. The web we've been building for three decades.

The second is being built underneath it. For machines.

The numbers

HUMAN Security's 2025 report measured a 7,851% year-over-year surge in AI agent traffic. Automated traffic is growing 8x faster than human visits. OpenAI accounts for 69% of observed AI-driven traffic, Meta 16.3%, Anthropic 10.8%.

Adobe measured a 4,700% year-over-year increase in AI agent visits to US retail sites alone.

In early 2025, AI bots accounted for roughly 1 in every 200 website visits. By late 2025, that ratio was 1 in 31. At current growth rates, agents will likely generate more internet traffic than humans by the end of this year.

The infrastructure already shipped

The supply side moved faster than most publishers noticed.

Cloudflare launched Markdown for Agents on February 12, 2026. Any site on its paid plans can now serve markdown to AI agents automatically through HTTP content negotiation. An agent sends an Accept: text/markdown header, and Cloudflare converts the page before it arrives. Their benchmarks: 16,180 HTML tokens down to 3,150 in markdown. An 80% reduction. Claude Code and OpenCode already send this header by default.

From Cloudflare's announcement: "Now is the time to consider not just human visitors, but start to treat agents as first-class citizens."

Jeremy Howard's LLMs.txt proposal, a simple markdown file at your domain root that points AI models toward your best pages, hit 844,000 implementations in under 18 months. Anthropic, Hugging Face, Perplexity, and Zapier adopted early. The companion format, llms-full.txt, which concatenates an entire site into one file, gets visited twice as often as the index.

Anthropic open-sourced the Model Context Protocol in November 2024. One year later: 10,000 active servers, 97 million monthly SDK downloads, client support in Claude, ChatGPT, Cursor, Gemini, Copilot, and VS Code. In December 2025, it was donated to the Linux Foundation, co-stewarded by OpenAI, Block, Microsoft, AWS, and Google.

None of this is theoretical. It all shipped.

The gap nobody's filling

All of this works for the public web. Blogs, docs, marketing pages, product listings. Content at a URL any crawler can reach.

But a large share of the internet's most useful content doesn't live on the public web. It lives in email.

Newsletters. Research reports. Market analysis. Investment memos. Industry briefings. All of it distributed to subscriber lists by platforms like Beehiiv, Substack, Ghost, ConvertKit, and Mailchimp. That content sits behind subscriber walls, wrapped in tracking pixels, stuffed with merge tags, rendered in email HTML that no agent framework was designed to parse.

An AI agent uses roughly 5x more tokens trying to make sense of newsletter HTML than it would on clean markdown. Most agents skip email content entirely.

Cloudflare can convert the public web. LLMs.txt can index your docs. MCP can wire up your API. But email inboxes? None of these tools reach them. No agent can subscribe to a newsletter, strip Beehiiv tracking links, clean ConvertKit merge tags, or store subscriber-only issues at permanent URLs.

We built Read By Agents to close this gap.

Forward your newsletter to convert@readbyagents.com. Every issue gets converted to clean markdown with ESP-specific handling for 13 platforms: tracking links stripped, merge tags removed, layout artifacts cleaned up. Each issue gets a permanent URL and a listing in an open directory that any agent can query through REST API, MCP, CLI, or LLM.txt.

Free. No paywall. No proprietary formats.

What this means for newsletter publishers

The web is splitting along an economic fault line.

One side optimizes for human attention: impressions, clicks, scroll depth, time on page. The advertising model that's powered the web since the late '90s. That model stops working when your visitor is a machine. CPMs are meaningless when agents don't render banner ads. Click-through rates don't apply when a language model extracts the answer without loading the page.

The other side optimizes for machine comprehension: clean structure, semantic markup, token efficiency, stable URLs. Different economics. Agents recommend, cite, and route traffic to content they can reliably parse. The publishers who show up in that layer accumulate visibility over time. The ones who don't are simply absent.

Newsletter publishers have an advantage they mostly haven't noticed. The content is original, it's fresh, and subscribers already trust it. That's what agents want to surface. The only barrier is format. Email HTML makes newsletters invisible to the entire agent layer of the internet.

The fix is straightforward. The head start for publishers who move early is not.

Read By Agents converts newsletters from 13 ESP platforms into clean, agent-readable markdown and hosts them at permanent URLs. Add your newsletter at readbyagents.com.
Sources:
  • HUMAN Security: AI Traffic Growth 2025 Key Findings
  • Cloudflare Blog: Introducing Markdown for Agents
  • Search Engine Land: Meet llms.txt
  • Pento: A Year of MCP
  • VC Cafe: The Web's Next Customer Isn't Human
  • The RBA Weekly

    Weekly intelligence on agent-readable content, delivered to newsletter operators who want their content discovered by AI.

    Subscribe free

    Free. Weekly. No spam.