In the context of LLMs memory can often mean a broadly defined, application-specific ability to detect, retain and re-use bits of useful context along the journey. In contrast to Persistence which is more like a DB with a schema and clear expectations, reliability, etc.