AI crawlers burden git.kernel.org with constant load

git.kernel.org spends more CPU cycles rendering commits for AI scrapers than on all legitimate access, with 14 cores across 5 nodes dedicated to rendering git commits as HTML. The post argues crawlers should clone repos instead of scraping rendered pages.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- MEES, Minimax H3 experiment
- llama.cpp PR list targets faster CPU inference
- Tutorial: Build ensemble weather forecasts with NVIDIA Earth2Studio
- AI band gets YouTube Official Artist Channel status
- Sony Music, Warner sue Anthropic over alleged IP theft