I think there is value in at least having some basic understanding what an LLM is - a statistical predictor, not something brain-like that is reasoning about facts, since it should change your mindset when using them.

I don't expect the public to do this though - I suspect there is really too big a gap from what LLMs actually are to what they appear to be for most non-technical people to be able to get their head around it.