AnalysisDevelopersAugust 29, 2026

AI crawlers burden git.kernel.org with constant load

git.kernel.org spends more CPU cycles rendering commits for AI scrapers than on all legitimate access, with 14 cores across 5 nodes dedicated to rendering git commits as HTML. The post argues crawlers should clone repos instead of scraping rendered pages.

1 source

Daily brief

Get tomorrow's AI brief in your inbox

More stories today

Open the live feed