GoKawiilLinux Foundation reports AI scrapers now dominate its git server traffic
The Linux Foundation's IT infrastructure director revealed that AI crawlers hunting for clean, LLM-free training data are hammering the organization's kernel.org git servers, consuming more CPU power than all legitimate human and tool access combined. Because cgit can generate near-infinite valid URLs for commits, diffs, and patches across hundreds of forks, scrapers are redundantly fetching duplicate data at massive scale.