https://blog.margrop.net/en/tag/context-window/ Recent content in Context Window on Margrop Blog Hugo -- gohugo.io en-US Sun, 19 Jul 2026 18:30:00 +0800 https://blog.margrop.net/en/post/ai-token-context-window-sticky-notes/ Sun, 19 Jul 2026 18:30:00 +0800 https://blog.margrop.net/en/post/ai-token-context-window-sticky-notes/ <blockquote> <p><strong>The short version</strong></p> <p>AI often appears to have a bad memory because only a limited amount of material can be carried into the model for the current request. Think of a context window as a stack of sticky notes with finite capacity. New questions and tool outputs keep adding notes. Once the stack is full, the system must summarize, truncate, filter, or remove older notes. If a note is removed from the current context, the model may no longer be able to use it.</p> </blockquote> <p>Have you ever told an AI, “Use Python for every code example,” only to receive JavaScript fifteen turns later? Or supplied a long document that the model can summarize accurately at the beginning and end, but cannot answer about the important restriction buried in the middle?</p> <p>It is tempting to say that the AI “forgot.” A more precise explanation is this: <strong>the model can only see what fits inside the current context window, and seeing a piece of text does not guarantee that every part of it receives equal attention.</strong></p> <p>This article explains tokens and context windows without turning them into intimidating mathematics. The main analogy is a stack of sticky notes. We will look at what tokens are, how a request is assembled, why long conversations become unreliable, why agents fill their context quickly, and how to make AI forget less through simple information management.</p>