Brief #226
Practitioners are shifting from 'throw more context at the model' to engineering structured feedback loops that preserve intent across sessions. The bottleneck isn't context volume—it's maintaining clarity about what problem you're solving while ensuring errors correct themselves rather than compound.
Blocker-to-Question Transform Prevents Agent Stalls
EXTENDS state-management — existing graph shows state as storage problem, this reveals it's a communication protocol problemInstead of having agents stop and explain when blocked, prompt them to ask specific questions about what they need. This keeps goals active, state preserved, and enables auto-resume without context reset.
Direct practitioner report: modified system prompt to transform 'stop and explain' into 'pause and ask specific question', preserving goal state and workflow continuity
Weekly Claude regeneration with aggregated context (medication, calendar, equipment, biometrics) creates personalized decision-making within safety constraints—shows how structured context + clear problem definition enables reliable agent behavior
Plain English rules passed to classifier model demonstrate that explicit constraints in context directly control agent behavior—clearer rules = better decisions
Constraint Files Amortize Agent Failures Across Sessions
Convert each agent failure into a permanent rule stored in a versioned constraints file. The agent accumulates guardrails without retraining—intelligence compounds through failure, not despite it.
Direct practitioner implementation: constraints file capturing failure patterns (bad citations, silent conflicts, scope drift) persists across runs, preventing repeated mistakes without retraining
Multi-Pass Refinement With Convergence Detection Beats Single Expensive Calls
Structure agent workflows as explicit refinement passes with convergence detection. Cheap models repeated with structured filters outperform expensive single-shot calls because intelligence compounds through iteration.
Leaked production architecture: deduplicate → verify → test → surface disagreements → repeat until convergence. Each pass carries forward and refines prior context rather than resetting
Harness Abstraction Layer Enables Agent Training at Scale
Insert a context-management abstraction layer between training loop and LLM. The harness owns tools, context, and control flow; trainers work with normalized pairs. This decouples environment complexity from optimization.
Microsoft research: harness layer handles tools/context/control, allowing training loop to optimize over clean LLM request/response pairs without environment complexity
Progressive Memory Allocation Solves Context Frontloading Problem
LLMs with uniform memory allocation waste capacity on early tokens. Progressive memory unlocking—allocating capacity proportionally to context depth—enables longer effective windows where past information compounds rather than dilutes.
Google's Proteus architecture solves frontloading: early tokens shouldn't consume same capacity as recent tokens. Memory allocation should be progressive, not flat
Hub-and-Spoke Multi-Agent Architecture Prevents Context Fragmentation
A coordinator agent maintains task context and orchestrates specialized agents. This reduces context fragmentation, enables human oversight at critical points, and prevents redundant work across parallel agents.
Chief of staff bot coordinates Twitter/blog/LinkedIn distribution bots, aggregates outputs, presents for human review—demonstrates central context hub pattern
Daily intelligence brief
Get these patterns in your inbox every morning — plus MCP access to query the concept graph directly.
Subscribe free →