

they don’t outright block ai crawlers. they added some new tools and options for managing or blocking ai bot traffic which the cloudflare customer can choose to use or to not use.
im running a free educational resource and i let the crawlers hit my site all they want because its useful knowledge unavailable anywhere else and it’s served to them from cloudflare’s free tier cache. i just don’t know why they have to read it ten thousand times a day.
maybe in the future a service offers a flat monthly fee to not have any ads and distributes the money to all of the content platforms that would otherwise show ads. basically it’s like a little government taxing users and giving the money to the capital owning class all over again