saavy_agent
My daily driver agent. It's one endless chat that keeps every message and compresses the history into a tree of summaries, so the model can zoom back into old context instead of losing it.
- stage
- building
- area
- agents
- stack
- pi-durable, OptChat memory, Tern
- source
- private for now
saavy_agent is based on Victor Taelin's OptChat setup and OptMem. There's one chat and it never ends. Every message gets appended to a log and kept word for word, and a cheap model compresses that log into a binary tree of one-line summaries.
Each turn, the agent starts fresh and sees a fixed-size view of the whole history: recent messages one line each, older stuff more and more compressed. When a line is too vague, it zooms in and opens that line into the two lines it was made from, all the way down to the original message.
The tree above is a small version of that. Messages come in, pairs merge into summaries, and the highlighted lines are what the model sees. Click an old message to zoom into it.
It renders in Tern, the new terminal from Stencil. I use it all day for real work, which is the best way I've found to figure out what's annoying about it.