ChatGPT’s crawler GPTBot, which spiders the internet to capture information and turn it into knowledge, is the most-blocked bot on the internet, according to Cloudflare’s 2025 year in review. Meanwhile its biggest rival, Google, is the No. 1 most-allowed crawler. And perhaps even more interestingly, while ChatGPT is the most-blocked bot, it’s actually Anthropic’s Claude AI engine that is the least reciprocally beneficial service for website owners.

Every year internet infrastructure company Cloudflare publishes an analysis of what’s happening on the internet.

Archive: http://archive.today/xvW1Q

Cite: https://radar.cloudflare.com/year-in-review/2025

  • Echo Dot@feddit.uk
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 day ago

    Yeah the sentence should really be rewritten as “to capture knowledge already accessible on the internet, and repackage it into an utterly pointless hallucinating RAM guzzling money pit”