Back to articles

Tag archive

#longhorizon

T
Aug 21, 2026

The transcript is a log, not an index: retrieval for long-running agents

Eviction and summarization keep a long-running agent's window small, but the summaries themselves still accumulate in the linear transcript — and on a run long enough, that accumulation becomes the new quadratic. Past a few hundred steps, the fix isn't a better compaction policy inside the window. It's moving history out of the window entirely and querying it like a database instead of replaying it like a log.

Aug 21, 20266 min read0 reactions0 comments
W
Aug 12, 2026

Why a long agent run costs O(N ) tokens — and how to flatten it

A naive agent's token bill doesn't grow with the number of steps — it grows with the square of them, because every step re-reads the whole transcript that every previous step appended to. A small cost model shows the curve, and four structural moves turn the quadratic back into something close to linear without dropping information the agent actually needs.

Aug 12, 20265 min read0 reactions0 comments