Short-Term Conversation Memory › Glossary

Conversation History: The list of messages exchanged between the user and agent, stored in order and sent with each new request to provide context.

Stateless Interaction: A request-response pattern where each interaction is independent, with no memory of previous exchanges.

Sliding Window Memory: A memory strategy that keeps only the most recent N messages, discarding older ones to manage context size and cost.

Context Window: The maximum number of tokens a language model can process in a single request, including both the conversation history and the new message.

Conversation Summarization: A technique that condenses older messages into a brief summary to preserve important context while reducing token count.

Token: The basic unit of text that language models process, roughly equivalent to a word or word fragment. Models charge per token and have maximum token limits.