The NN has copyright material stored (maybe in compressed form) inside of it.

There isn't anything like enough space in one of these models to store all the training material, "compressed" or otherwise. Not by orders of magnitude.