Cloudflare Blocks AI Crawlers by Default

Ever get that feeling your hard work is just being hoovered up by AI bots for free? Your articles, your art, your data, all feeding the machine without your permission.

Well, Cloudflare just dropped a bombshell that could change everything. They’re now going to block known AI web crawlers by default for all new websites on their platform. This is a massive shift in power back to creators!

But here’s the game-changing part: they’re launching a Pay Per Crawl program. It’s a super simple idea:

  • You, the publisher, get to set a price for AI companies to access your content.
  • The AI companies see the price and can choose to pay to crawl or turn away.
  • You finally get compensated if they decide your content is worth it.

Right now, this is only for a select group of publishers, but it’s a huge signal for the future. It’s an awesome move that ensures AI companies have to start using content the right way: with permission and compensation. A huge win for creators!

Scroll to Top