LLMs have a chance to make anything they've been trained on, by outputting it verbatim (or with small modifications).

The question is the degree to which they can produce original things.