Pay to crawl as Cloudflare buys Human Native for the AI age

MUMBAI: In the fast-evolving internet economy, content is no longer just read, it is trained on. And Cloudflare has decided it is time creators got paid for it. Cloudflare has announced the acquisition of Human Native, an AI data marketplace designed to connect content creators with AI developers willing to pay for high-quality, usable data.

The move is aimed squarely at one of the internet’s most contentious questions: who controls, prices and profits from the data fuelling artificial intelligence. By bringing Human Native in-house, Cloudflare plans to make it easier for AI developers to discover and license reliable content, while giving creators and publishers tools to decide whether to block AI bots, optimise content for AI use, or sell access at a fair, transparent price.

At the heart of the deal is Cloudflare’s broader push to shape what it calls the next phase of the open internet. Cloudflare co-founder and CEO Matthew Prince said the acquisition builds on earlier efforts that allowed publishers to control which bots could access their sites. The bigger ambition, he noted, is to create an economic model where content can be discovered, priced and purchased openly, rather than scraped silently.

Founded in 2024 and backed by UK venture firms Localglobe and Mercuri, Human Native was built to address what its founders describe as the “Napster era” of generative AI, where content is widely used but rarely compensated. The team brings experience from companies including Deepmind, Google, Figma and Bloomberg, expertise Cloudflare hopes will accelerate tools that let creators structure and monetise their data without friction.

For AI companies, the appeal is equally clear. As competition intensifies, access to differentiated, high-quality data has become a key battleground. Human Native’s marketplace model is designed to surface valuable datasets while giving rights holders visibility, control and credit.

The acquisition underlines a shift in how the internet’s plumbing is being rewired for AI. Rather than choosing between blocking machines or giving content away, Cloudflare is betting that a third option, pay per crawl, could keep the web both open and economically sustainable.