purrtastic@lemmy.nztoTechnology@lemmy.world•TikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIEnglish
48·
19 days agoIt’s not fine. They are not archiving the internet.
I had to ban their user agent after very aggressive scraping that would have taken down our servers. Fuck this shitty behaviour.
I haven’t read wired in a few years, and it looks like I haven’t missed anything.