Short-Term vs Long-Term Memory in LLMs, and What "Context Memory" Actually Means

Short-term memory in an LLM is whatever sits in the context window on the current call: the system prompt, the recent conversation, tool results and any retrieved text, all re-sent by the application on every request and gone when the request ends.