Konstantin Ryabitsev says AI crawlers now create a constant load on git.kernel.org, with scrapers generating far more CPU work rendering Linux kernel commits as HTML than legitimate access including git clones.
Creepy crawlies
Konstantin Ryabitsev says AI crawlers now create a constant load on git.kernel.org, with scrapers generating far more CPU work rendering Linux kernel commits as HTML than legitimate access including git clones.
Source: Kernel