How to Give an LLM Long-Term Memory, and Why RAG Alone Is Not It
You give an LLM long-term memory by adding a layer outside the model that decides what is worth keeping from each conversation, stores it against the right person, updates it when a fact changes, and puts only the relevant slice back into the prompt on the next call.