
Long context vs RAG: why search when a model reads it all?
Long context vs RAG: a big context window can hold a whole document, but every resend costs input tokens and facts in the middle can be missed. Test both.
Tag archive

Long context vs RAG: a big context window can hold a whole document, but every resend costs input tokens and facts in the middle can be missed. Test both.
A kept chat grows every step, so it runs into the context window. Measured on a 7B model: with the...

Large language models now ingest entire repositories in a single inference call, but uncurated inputs...
Chunking, map-reduce, retrieval and compaction: how agents handle work that never fits in one context window, and keep their own history lean.
从零手写 Agent(二):短期记忆,其实就是你一直带着的 messages 上一篇把 Tool 跑通以后,我开始给 Agent...
从零手写 Agent(三):上下文超长,别等模型替你截断 第二篇里,我做了一个比较极端的压测。 把 Ollama 的 num_ctx 调得很小,然后不断往 messages...
Cline's automatic context compaction is supposed to summarize prior conversation history when a long...
8 Benefits Nobody Talks About There's more to token optimization than a smaller API bill....

You've hired a goldfish to guide you through the aquarium. He's enthusiastic, knowledgeable, and...
"Context engineering" is getting used as a rebrand for prompt writing, and that undersells it into uselessness. The actual discipline is deciding, every single turn, what earns a place in a bounded window and what gets evicted — and living with the fact that every eviction is a bet you're making about the future of a run you haven't finished yet. Here's the physical constraint underneath the buzzword, the packing decision that's actually hard, what it costs to get it wrong, and how to test whether your packing policy works.
In this article, we review Context-Mode. You will learn: What is Context-Mode? The problem How...
The documented target is under 200 lines per CLAUDE.md file. What that number means, the separate 4 MiB limit, and whether to trim, split or move cont