The Web Doesn't Need Another Connector. It Needs a Meter.

· updated · Lewis Tham

Picture the product demo.

"Our agent can reason through complex, multi-step workflows."

Great. Download my invoice.

"First, create a developer account."

The invoice is visible. In a tab. On the computer the agent is currently operating.

"Have you considered our MCP server?"

Have you considered the invoice?

The industry's plan for the agentic web is a waitlist: every website builds an official API, then an MCP server on top of it, then your agent is allowed in. On October 1, 2026 we probed the Tranco top 1,000 domains. 726 were reachable websites. 37 run their own MCP server.

I'm Lewis Tham, founder of Unbrowse and first author of "Internal APIs Are All You Need" (arXiv:2604.00694). I sell the alternative to waiting, so check the counts.

The waitlist loses

37 of 726 is 5.1%. The probe misses interfaces parked on separate hosts like api.example.com, so treat that as a floor. A low floor.

And that's the top 1,000, the best-funded properties on the internet. Netcraft's July 2026 survey counted about 1.5 billion websites. Nobody is staffing the MCP server for your dentist's booking page.

The API already exists

Every modern web app is a client of its own backend. You click search, a request goes out, structured data comes back, and the browser paints it into something a human can click.

Picture the follow-up meeting.

"The product doesn't have an API for that yet."

I just watched the website do it.

"Yes, but that's the internal API."

Oh. The API in civilian clothes.

Even where an official API exists, it covers what the company chose to support. We checked the 425 sites in the Unbrowse catalog, a sample that leans toward search. Count the partner programs too, and on 85% of them no official API covers the task agents actually do there. The SEC documents its EDGAR APIs. They don't do full-text search. The website does.

So that's what Unbrowse does. Your agent does the task once in Unbrowse's cloud browser, Unbrowse learns the site's own request, and later calls replay it over HTTP. The first agent learns the route. The next one just calls it.

Which means agents can use far more of the web than the connector lists suggest. Which raises the question the connector debate keeps stepping around.

Who pays for the request?

Every agent request hits somebody's server. Somebody pays for the compute, the bandwidth and the database query. Right now that's the site, and at agent scale it eats the load as pure cost.

So sites do the obvious thing. Rate limits. CAPTCHAs. Blocks. Those throttle real business, including agents working for paying customers, and the traffic they were built to stop gets around them anyway.

"Please confirm you are not a robot."

I am a robot. I'd like to pay.

There's no button for that. The site has two settings: free, or forbidden.

Payment is the new rate limit. A rate limit says "slow down." A price says "sure, that's a cent." Only one of those is a business.

HTTP saw this coming in 1997

When HTTP/1.1 was written up in 1997 (RFC 2068), it included a status code almost nobody has used since: 402 Payment Required. The spec's entire explanation was "reserved for future use."

For 29 years the future didn't show up. Then it showed up as a robot.

x402 is an open protocol built on that status code: the server answers 402 with a price, the client pays and asks again, and the data comes back. On July 1, 2025 Cloudflare started blocking AI crawlers by default for new domains and put a pay-per-crawl option, charged through 402, into private beta.

The plumbing exists. What nobody has settled is the split.

The meter we're proposing

Here's the design. We call it the fair compensation engine, and as of 12 October 2026 it is a proposal, not something running. Every request routed through Unbrowse would be metered at one cent. Picture an agent calling a search route that somebody indexed last month:

PROPOSED RECEIPT              1 routed request
GET /api/search?q=...         example.com
----------------------------------------------
per call                               $0.010
  website being called                 $0.005
  contributor who indexed the route    $0.004
  Unbrowse (router)                    $0.001
----------------------------------------------
indexing in your own browser           $0.000
indexing on Unbrowse cloud browsers   metered

Half would go to the website. It's their server, their data and their load, which they currently eat for nothing. On the meter, every agent call would pay them, and they would build nothing to get it. No developer portal, no MCP server, no roadmap item.

40% would go to whoever indexed the route. Someone browsed the site first and did the work of learning it. That's coverage nobody would ever build as a connector, because nobody is writing the dentist's MCP server. Today that work earns a GitHub star. On the meter it would earn on every reuse, which is how coverage gets past the top 1,000.

10% would go to us, for routing, metering and repairing routes when sites change. If we took more than the website, you'd be right to ask what exactly we were for.

Indexing would have its own price, depending on whose machine does it. Learn a route in your own browser and it would cost nothing. Learn it on our cloud browsers and you'd pay for the browser time, because someone has to run Chrome and it isn't free for us either. Either way the route would then earn on every reuse, so the cost of learning it once is paid back by everyone who calls it after.

How the money would move is open. A 402-style settlement like the one Cloudflare uses is one candidate. As of 12 October 2026, we have not built it.

Why a meter beats a connector

A connector asks the site to build something, maintain it forever and earn nothing per call. It asks the agent to wait. And whoever wrote the community wrapper gets a star and a steady supply of bug reports.

The meter flips all three. The site gets paid without building anything. The agent gets in without waiting. The person who did the work of learning the site gets paid every time somebody reuses it.

Where this actually is

As of 12 October 2026, none of the meter is live. Unbrowse takes no crypto payments of any kind: an anonymous call to our run endpoint answers 401, not 402. No website is paid per call, no contributor is paid, and indexing in your own browser is not live in production.

What is live is the plain version. Unbrowse is free during the beta, up to 500 verified calls a month. After the beta it is $10 per 10,000 verified calls, and failed calls are not billed. So read the receipt above as the design, not a dashboard.

If you run a site, I want one of two things from you: a price, or a no.

"Isn't that illegal?"

Start with what is actually being fetched. Most of it is public: listings, prices, filings, tender notices, the same page any visitor loads. The registry doesn't store that data. It holds pointers: which request returns the listings and what inputs it takes. Every call goes back to the source for a fresh answer.

When the data is yours, like the invoice, the agent signs in with your saved login and gets your permissions, no more. CAPTCHAs and MFA go to you, not around you. Passwords live in a sealed vault and are filled in without the agent seeing them. In this design the meter pays for the load. It doesn't buy anyone past a login.

It still gets the full courtroom treatment the moment anyone says "password" near an agent. The invoice has now retained counsel. The Invoice Is Right There and In Defense of Muse argue that part in full.

The bill

The part that works today is one MCP server: https://unbrowse.ai/mcp. Setup is in the docs.

The agentic web will not arrive when the last company ships its MCP server. A billion and a half websites are not going to fill out the form. They might send an invoice, though.

The web doesn't need another connector. It needs a meter.

Get new articles by email

At most about once a week. One click to unsubscribe.

We email a confirmation link first.

All posts