I self-host my own code forge (a gitea instance) and I've mirrored a couple of large repositories on it. The traffic from AI crawlers was bringing my entire server to its knees. As soon as I put the large repos behind a login, my server's CPU usage dropped to ~5%. I don't doubt for a second that github is under a torrential downpour of AI crawler traffic. Those locusts destroy everything they touch.
Comments
I self-host my own code forge (a gitea instance) and I've mirrored a couple of large repositories on it. The traffic from AI crawlers was bringing my entire server to its knees. As soon as I put the large repos behind a login, my server's CPU usage dropped to ~5%. I don't doubt for a second that github is under a torrential downpour of AI crawler traffic. Those locusts destroy everything they touch.