Tag archive
A 2026 decision framework for choosing RAG vs long context vs hybrid: real 1M-token pricing math, recall trade-offs, and a when-to-use-which table.
A new systems paper called LongStraw shows reinforcement-learning post-training can execute on prompts beyond 2 million tokens on a fixed 8-GPU budget by scoring the shared prompt once without gradients and backpropagating only through the short gene
2M-token context vs RAG in 2026: cost, latency and when each actually wins Summary. Google...
Tencent's Hunyuan team introduced HiLS, a sparse-attention method that learns end-to-end which parts of a long document to focus on, matching full attention while handling context 64 times longer than it was trained on.
Two new techniques treat a language model's long-context memory like an operating system's memory hierarchy - keeping coarse summaries on the GPU and paging compressed detail out to the CPU - with one, SeKV, cutting GPU memory use by 53% at 128,000 t
MiniMax M3 needs 32GB+ at Q4 + massive KV cache for 1M context. RTX 5090 32GB is the consumer floor. 5 GPUs ranked for 1M-context RAG in 2026.
Z.ai released GLM-5.2, an agentic coding model with a reliable one-million-token context and top open-source scores on long-horizon software benchmarks, with an MIT-licensed weight release promised within weeks.
Long-context models have moved from novelty to necessity. If you're analyzing legal contracts,...
컨텍스트 창이 200k 토큰까지 커졌지만 단순히 다 넣으면 lost-in-the-middle·비용 폭발·정확도 하락이 옵니다. 마케팅 자동화에 적용하는 5가지 컨텍스트 설계 원칙.
DeepSeek previewed two free-to-download V4 models that can read a million tokens at once, no longer as a premium add-on but as the standard setting.
The Promise vs The Reality Mamba and RWKV both claim to solve the $O(n^2)$ attention...
A practical guide to Gemini 3.1 Pro's 1M-token context window, native multimodal inputs, sandboxed code execution, and API setup for 2026.