Back to Developer Roadmap

Context Compaction

src/data/roadmaps/ai-engineer/content/[email protected]

4.0722 B
Original Source

Context Compaction

Context compaction is a technique used to reduce the length of the context provided to a large language model (LLM) without sacrificing relevant information. This process aims to remove redundant, irrelevant, or less important information from the context window to make room for more data or improve the efficiency and effectiveness of the LLM's processing. Compaction can involve techniques like summarization, filtering, or re-ranking of context information.

Visit the following resources to learn more: