which anybody can now easily “regenerate”

I don't think this is as clear as you say it is. If a person "regenerates" GPL code from memory, it will still be a copyright violation. LLMs can't own copyright on their own, so a person must be responsible for the result. So it should be a violation. GPL should help (if you actually sue).