I've long wondered how Cloudflare would leverage its position as a prominent intermediary between web publishers and web readers. Here's one sign: "Cloudflare has started blocking AI web crawlers by default in a bid to become the internet's gatekeeper." They will, in effect, monetize the web. "Each time an AI crawler requests content, they either present payment intent via request headers for successful access (HTTP response code 200), or receive a 402 Payment Required response with pricing," explained Will Allen, VP of product, and Simon Newton, engineering manager, in a blog post."
Today: Total: [Direct link] [Share]
