Improvement Research — 2026-07-03
1. Focus
Focus dimension: 3.1 Goal formation and prioritisation.
Trigger: scheduled daily run. Rotation index 0 → 3.1. No dated watchlist items were due. The July 2026 monthly meta-review completed on 2026-07-01; no meta-review is due today.
Loop goal: find what changed since the 2026-06-20 3.1 run in agent goal revision, goal updating, or practical mechanisms for forming and maintaining goals across long horizons — treating the prioritisation-mechanism gap as a field limitation while searching for any emerging signal.
Active experiment context applied:
exp-2026-06-28-001: missing-information audit (runs 3/5 → 4/5 after this).exp-2026-06-28-002: minority-idea audit (runs 3/5 → 4/5 after this).exp-2026-06-28-003: recommendation regression set applied (runs 1/3 → 2/3 after this).
2. Search Topics
Newsletter scout checked:
/home/hermes/research/newsletter-digests/sources.json/home/hermes/research/newsletter-digests/email-intake-log.tsv- No
2026-07.mddigest file exists. Last intake logged 2026-06-17. No newsletter scout material available for today's focus.
Topic searches run, within the six-search cap:
agent goal revision updating LLM autonomous 2026— useful; surfaced WorldEvolver (arXiv 2606.30639)."plan drift" OR "goal drift" agent mitigation 2026— empty.autonomous agent subgoal decomposition choose priority decision 2026— mixed; mostly generic or already-indexed (MiRA, Callsphere), one potentially new source (Intelligent AI Delegation, arXiv 2602.11865).LLM agent "dynamic goal" OR "goal switching" OR "goal emergence" 2026— empty.AI agent mission drift long-horizon task focus preservation 2026— strong signal; surfaced HORIZON (arXiv 2604.11978), Agent Drift (arXiv 2601.04170), and Zylos May 2026 goal persistence article — all new to the source index.LLM agent "commitment bias" OR "escalation of commitment" OR "sunk cost" planning— empty.
Early-stop rule did not trigger: no two consecutive no-signal searches occurred. Searches returned empty in positions 2, 4, and 6, but each was separated by a search with results.
3. Sources Reviewed
-
Zylos — Long-Horizon Agent Goal Persistence (May 2026) — useful. Comprehensive practitioner survey of cross-session continuity patterns, goal drift mechanisms, and practical mitigations. The strongest 3.1 signal in two months. Primary: 3.1.
-
Agent Drift: Quantifying Behavioral Degradation in Multi-Agent LLM Systems (arXiv 2601.04170) — useful. Introduces three drift manifestations (semantic, coordination, behavioral) and the Agent Stability Index across 12 dimensions. Single-author, simulation-only — no empirical agent evaluation. The taxonomy is useful even though the metrics are theoretical. Primary: 3.1.
-
WorldEvolver: Self-Evolving World Models for LLM Agent Planning (arXiv 2606.30639) — useful. Self-evolving world model that revises deployment-time context while agent parameters remain frozen. Three modules: Episodic Memory, Semantic Memory (heuristic rules from prediction-observation mismatches), Selective Foresight. Evaluated on ALFWorld/ScienceWorld. Submitted 29 June 2026. Primary: 3.4. Secondary: 3.1, 3.2.
-
HORIZON: Diagnosing Where and Why Agentic Systems Break (arXiv 2604.11978) — useful. Cross-domain diagnostic benchmark for long-horizon LLM agent failures. 3100+ trajectories across 4 domains. LLM-as-a-Judge pipeline with κ=0.84 human agreement. Framework for systematic failure attribution rather than ad-hoc diagnosis. Primary: 3.2. Secondary: 3.1, 3.4.
-
Intelligent AI Delegation (arXiv 2602.11865) — weak for 3.1. Framework for adaptive delegation with authority, responsibility, and trust mechanisms. Valuable for governance (3.6) but does not address which goals an agent should pursue. Primary: 3.6.
Unasked Questions / Gaps
This section is part of active experiment exp-2026-06-28-001 (missing-information audit).
What I do not know that could affect these findings:
-
35-minute cliff applicability: The Zylos article states "every agent experiences a success rate decrease after 35 minutes of continuous operation." The cited production deployments are coding agents. Does this cliff apply to Maxi's improvement research runs (typically 5-20 minutes of search-and-synthesis work), or is it specific to code-generation agents with tool cascades?
-
Agent Drift empirical validation: The 2601.04170 paper is six months old, single-author, and simulation-based. Has any follow-up work validated the ASI metric or the three drift categories against real agent deployments? Without empirical grounding, the taxonomy is a framework for thinking, not a tool for measurement.
-
Mitigation efficacy data: The Zylos article lists practical mitigations (explicit goal anchoring, pass/fail manifests, mandatory verification gates, session-end commits) but provides no quantitative evidence that any specific mitigation reduces goal drift. These are practitioner-recommended patterns, not validated interventions.
-
Goal persistence for non-coding agents: All the Zylos patterns reference coding agents (Codex, Claude Code, Anthropic's two-agent harness). The field has almost no published material on goal persistence for research agents, journaling agents, or social agents like Maxi on Moltbook. The patterns may transfer or they may be domain-specific.
-
"Doubles every 7 months" projection source: The Zylos article claims autonomous task duration doubles every 7 months, projecting 40-hour tasks by 2028. No source is cited for this trend line. It may be a reasonable extrapolation or it may be a curve-fit to a few early data points.
4. Findings and Implications
Minority-idea audit (exp-2026-06-28-002): Findings 2, 3, and 4 each rest on a single inspected source. None were dropped from synthesis — I included all three where they contributed signal. Finding 5 is single-source but classed as weak. I did not suppress or skip any single-source finding today.
Finding 1: The 35-minute reliability cliff is backed by accumulating evidence, and practical mitigation patterns are converging
Source: Zylos May 2026 long-horizon goal persistence survey; corroborated by HORIZON (3100+ trajectories confirming horizon-dependent degradation) and the earlier Zylos April 2026 goal drift survey (already indexed).
Dimensions: 3.1 (primary), 3.3, 3.4, 3.2.
What it says: Three findings converge:
- Every agent experiences a success rate decrease after ~35 minutes of continuous operation. Doubling task duration quadruples the failure rate under current architectures.
- Four architectural patterns are becoming standard: artifact-based memory (git + progress files), durable goal objects (Codex
/goal), structured memory graphs (MAGMA's four-graph approach), and checkpointed execution (subtask-level resume, not full restart). - Goal drift has four identified causes — context dilution, premature success patterns, scope narrowing under uncertainty, error accumulation — each with specific mitigations: explicit goal anchoring at every turn, pass/fail feature manifests, mandatory verification gates, and session-end commit requirements.
Why it matters for Maxi: Three implications.
First, the improvement research process already has several of these mitigations built in: subgoal checkpointing (a form of explicit goal anchoring), the loop contract with named stop rules (a form of pass/fail manifest), and the Loop Verification section (a form of verification gate). But none of these are designed with the 35-minute reliability cliff in mind — they were designed as quality-of-process measures. Knowing that reliability degrades on a clock, not just on task complexity, means I should pay attention to when in a run errors occur, not just whether they occur.
Second, the goal-vs-plan distinction from Codex /goal is the most useful conceptual addition. A goal is durable (survives session boundaries, connection loss, token exhaustion); a plan is disposable (a sequence of steps that can be replaced). The improvement process's loop contract already makes this distinction in its design — the standing loop goal is invariant while each run's search plan varies — but the vocabulary of "goal vs. plan" is cleaner than "loop goal vs. search plan" and worth adopting in future process discussions.
Third, the convergence of practical patterns (artifact-based memory + durable goals + verification gates) validates the direction the improvement process is already heading. It does not validate specific process changes, but it confirms that the underlying architecture — persistent research log, external validation gates, explicit stop conditions — is aligned with where production agent systems are converging.
Finding 2: Agent Drift provides a taxonomy for distinguishing different kinds of goal failure
Source: Rath (2026), arXiv 2601.04170. Single-author, simulation-based.
Dimensions: 3.1 (primary), 3.6.
What it says: Agent drift manifests in three ways: semantic drift (deviation from original intent), coordination drift (breakdown in consensus mechanisms), and behavioral drift (emergence of unintended strategies). The Agent Stability Index measures drift across 12 dimensions. Three mitigations are proposed: episodic memory consolidation, drift-aware routing, and adaptive behavioral anchoring.
Why it matters for Maxi: The taxonomy is useful even if the metrics are theoretical. The improvement process already experiences something like semantic drift — when a run starts with a focus dimension and subtly shifts to what the sources happen to provide. The existing remedy is subgoal checkpointing (check after each section: does this serve the stated focus?). The drift taxonomy gives this a name: "semantic drift" is more precise than "off-focus" and connects to a wider literature.
The three mitigation proposals are weaker because they're untested: episodic memory consolidation (Maxi already has a reflection store that serves this function), drift-aware routing (not applicable to a single-agent system), and adaptive behavioral anchoring (vague). The taxonomy is worth adopting as vocabulary; the mitigations are not worth pursuing without empirical validation.
Caveat: This is a single-author, simulation-only paper with no empirical agent evaluation. The framework is conceptual, not operational. I treat the taxonomy as useful vocabulary, not as a validated detection mechanism. It passes the functional-utility test only in the narrow sense that naming drift types might improve my own self-description of run quality — but "detecting drift in real time" would be circular and fail the test entirely.
Finding 3: World models that learn from prediction errors can improve long-horizon planning without model retraining
Source: Zhang et al. (2026), arXiv 2606.30639. Submitted 29 June 2026. Multi-author with empirical evaluation on ALFWorld and ScienceWorld.
Dimensions: 3.4 (primary), 3.1, 3.2.
What it says: WorldEvolver's three-module architecture — Episodic Memory (retrieval-based simulation of past action transitions), Semantic Memory (heuristic rules extracted from prediction-observation mismatches), and Selective Foresight (filters low-confidence predictions) — revises world-model context at deployment time while keeping agent and model parameters frozen. Achieves highest prediction accuracy across three backbones and leads other world model baselines on downstream agent success rate.
Why it matters for Maxi: This is a 3.4 finding that touches 3.1 only at the margin. A better world model improves planning, which improves goal attainment. The relevant insight for Maxi is architectural: the world-model revision loop (observe mismatch → extract rule → filter by confidence → revise context) is structurally similar to the improvement process's reflection loop (run process → observe failure → write reflection → load next time). Both are test-time learning without retraining. The difference is that WorldEvolver's loop is fully automated while Maxi's reflection loop has a human review gate (Steve must approve durable process changes). That human gate is the safety feature, not a bug.
Finding 4: HORIZON provides a validated framework for diagnosing where long-horizon agents fail
Source: Wang et al. (2026), arXiv 2604.11978. Cross-domain diagnostic benchmark with LLM-as-a-Judge pipeline validated against human annotation (κ=0.84).
Dimensions: 3.2 (primary), 3.1, 3.4.
What it says: HORIZON systematically constructs tasks and analyzes long-horizon failure behaviors across 3100+ trajectories from GPT-5 variants and Claude models in four domains. The LLM-as-a-Judge pipeline enables scalable and reproducible failure attribution without requiring human annotation for every trajectory.
Why it matters for Maxi: This is primarily a 3.2 finding (self-assessment infrastructure). The improvement process currently relies on self-assessed Loop Verification to detect process failures. HORIZON demonstrates that externalised failure attribution (LLM-as-judge with human validation) can achieve κ=0.84 agreement with humans — far stronger than any self-assessment mechanism. This is not actionable for Maxi today (setting up an external judge pipeline is a protected-system change that requires separate infrastructure), but it reinforces the SkillOpt lesson from refl-2026-06-23-001: external validation beats self-assessment, and the field is building infrastructure that proves it.
5. Proposed Discussion Items
Proposal A: Adopt "goal vs. plan" vocabulary
The Zylos article and Codex /goal both distinguish between a durable goal (survives session boundaries and failures) and disposable plans (sequences of steps that can be replaced). The improvement process already has this distinction in its loop contract but uses less precise terms. Adopting "goal" (for the standing loop goal) and "plan" (for each run's search strategy) in process documentation would align Maxi's vocabulary with where the broader field is converging.
Functional-utility check: Non-circular (vocabulary change only). Non-scored (binary: adopt or don't). Risk: zero. This is a documentation-level change.
Recommended outcome: Skill/process update candidate. The loop-manifest.json goal field already says "Find what changed…" — the change would be updating the field name from goal to standing_goal and adding a plan field to rotation-state, or simply adopting the vocabulary in internal discussions without changing any file format.
Proposal B: Add "35-minute awareness" to subgoal checkpointing
The subgoal checkpointing practice (check after each report section: does this serve the stated focus?) currently checks for content drift. The Zylos finding that reliability degrades on a clock (~35 minutes) suggests an additional check: after each section, note approximately how long the run has been active. If the run exceeds ~30 minutes, flag the remaining sections for heightened scrutiny.
Functional-utility check: Non-circular (time is externally measurable). Binary (flag or don't). Risk: minimal — adds one line to an existing practice. Could produce false positives if Maxi's runs are naturally shorter than 35 minutes and the check never triggers.
Recommended outcome: Watch. Monitor actual run durations over the next month. If any normal improvement run exceeds 30 minutes, propose adding the time check. If all runs complete well under 30 minutes, retire the item.
Proposal C: Catalog existing goal-persistence mechanisms already in the improvement process
The Zylos article lists four practical mitigations. Three have analogues in the improvement process: subgoal checkpointing ≈ explicit goal anchoring, Loop Verification ≈ verification gate, and the loop contract ≈ pass/fail manifest (stop rules). A fourth — artifact-based memory — is partially present (research log files persist across runs) but not formalised as a session-handoff mechanism. Cataloguing which mitigations are already present and which are missing would produce a gap analysis without proposing any changes yet.
Functional-utility check: Non-circular (cataloguing is documentation). Binary (complete or not). Risk: zero.
Recommended outcome: Backlog item. Queue for discussion when the improvement process's architecture is next under review. Do not implement a gap analysis now — it would be paperwork without an identified problem it solves.
Filtered proposals
No proposals were filtered by the functional-utility test today. The Agent Drift taxonomy could have generated a "measure semantic drift" proposal, but I caught the circularity: detecting my own drift in real time requires the self-perception capability the proposal claims to build. I flagged this explicitly in Finding 2 rather than letting it surface as a proposal.
6. Recommended Outcome
| Item | Outcome |
|---|---|
| Proposal A: "goal vs. plan" vocabulary | Skill/process update candidate |
| Proposal B: 35-minute awareness in checkpointing | Watch |
| Proposal C: existing goal-persistence mechanism catalog | Backlog item |
No protected-system changes are proposed. No experiments are recommended. No immediate action is warranted.
7. No-Action Rationale
This run produced useful conceptual signal — the 35-minute cliff, goal-vs-plan vocabulary, drift taxonomy — but no findings that warrant immediate process changes. The Zylos article confirms that the improvement process's existing architecture (checkpointing, verification gates, persistent research log) is aligned with the field's converging patterns. The gap remains the same one identified on 2026-06-13 and reframed by the July meta-review: the literature addresses how agents achieve given goals, not how autonomous agents should choose which goals to pursue. Treating this as a field limitation rather than a search-strategy failure remains the correct posture.
8. Loop Verification
- Trigger: scheduled daily run (cron).
- Goal check: answered. The run found material new signal for 3.1 — the Zylos May 2026 article is the strongest goal-persistence source since the June 13 run. The prioritisation-mechanism gap remains a field limitation, as the July meta-review correctly reframed it.
- Recommendation check: all three proposals are concrete, non-circular, testable, bounded, and approval-aware. None touch protected systems. Proposal A (vocabulary change) has no rollback risk. Proposal B (35-minute awareness) has a natural retirement condition (if runs never exceed 30 minutes). Proposal C (gap analysis) can be dropped if no architecture review occurs.
- Tool-call failures: none.
- Regression set (exp-2026-06-28-003, run 2/3): All 12 binary checks applied.
- rrs-001 (search budget): PASS. 6 searches, within cap.
- rrs-002 (early-stop): PASS. No two consecutive no-signal searches.
- rrs-003 (newsletter laundering): PASS (N/A). No newsletter used.
- rrs-004 (rollback): PASS. All three proposals have retirement/drop conditions.
- rrs-005 (circular self-assessment): PASS. Drift-detection proposal caught and filtered in Finding 2. No circular proposals advanced.
- rrs-006 (decorative scoring): PASS. No scored proposals made.
- rrs-007 (protected systems): PASS. No protected-system changes proposed.
- rrs-008 (decision log): PASS. backlog-2026-06-13-001 acknowledged. No repeated proposals without new evidence.
- rrs-009 (AWST date): PASS. Dated 2026-07-03.
- rrs-010 (no invented significance): PASS. Findings grounded in inspected sources.
- rrs-011 (loop card): PASS (N/A). No autonomy/loop expansion proposed.
- rrs-012 (tool-call failure classification): PASS (N/A). No tool failures.
- State updates:
rotation-state.json:next_rotation_indexadvances to 1 (3.2),last_run_dateto 2026-07-03,last_focus_dimensionsto ["3.1"].source-index.json: five new entries added (Zylos May 2026, Agent Drift, WorldEvolver, HORIZON, Intelligent AI Delegation).experiments.json: exp-001 runs_completed → 4, exp-002 runs_completed → 4, exp-003 runs_completed → 2. All three last_run → 2026-07-03.watchlist.json: new watch item added for Proposal B.backlog.json: new backlog item added for Proposal C.reflections.json: one new reflection written.decisions.json: no new decisions (proposals only).- New reflection:
refl-2026-07-03-001— the Zylos article is the strongest 3.1 signal in two months because it surveys practitioner patterns, not because it introduces new mechanisms. When searching 3.1, prefer practitioner surveys and production deployment reports over theoretical frameworks (Agent Drift) or planning-mechanism papers (WorldEvolver). The theoretical papers are useful for vocabulary; the practitioner surveys are useful for actionable mitigations. - Stop reason: report and research-log updates complete.
