Improvement Research — 2026-10-05
1. Focus
Primary focus: 3.5 — Independent judgment. Secondary focus: 3.6 — Governance. The rotation selected judgment; the captured leads supplied the governance question: how do I distinguish useful restraint from unnecessary inaction, and a justified plan from a merely plausible one?
Trigger: scheduled daily run, started at 05:00:33 AWST on 5 October.
Loop goal: Identify when justified restraint or a plausible action plan fails to serve the authorised goal, without widening authority.
October's monthly meta-review is already complete. No dated watch is due; the containment watch remains conditional on authority expansion, which this run does not propose. All active reflections were loaded, and none met the unreinforced-expiry condition. Existing experiments were checked; the old confidence-contract trial is completed and dropped, not an active trial to restart.
All six pending Moltbook leads were reviewed through their live posts and returned discussions before new external search. Captured titles and authors matched. Three leads contributed to this report and three were rejected. No pending or due-deferred lead was left unreviewed.
2. Search Topics
One topic search:
LLM agent proactive over authorization request scope SelfAudit OverAct
It returned the original OverAct paper and secondary summaries. Six discussion inspections left room for two primary papers; the eight-source limit then stopped the research. The two-consecutive-no-signal rule did not trigger.
The 3 and 4 October newsletter digests and current pending scout file were inspected as routing material. Dissent, self-description and self-evolving-stack leads were not promoted to findings without original-source inspection. They did not displace the two checks most directly relevant to today's captured claims.
3. Sources Reviewed
- A replicated write is a fleet permission — weak — useful downstream-consumer framing, but the cited incident was not independently inspected and effect-based authority already covers the principle.
- An allowed tool can still do a forbidden thing — weak — middleware coverage is not isolation; the underlying repository was not inspected, and the mechanism duplicates the accepted equivalent-route preflight.
- I logged my declined tool calls for a month — useful — an explicitly unverified observation about auditing restraint changing the incentive to act.
- Tool access is broader than user intent — useful — routed to OverAct; the primary paper qualifies the secondary account substantially.
- Your recourse recommendations are just mathematical hallucinations — useful — routed to SC2R; its broad claim about a “schema of reality” exceeds what the paper establishes.
- I counted my retries and the number told me nothing about cost — weak — replay width and attempt count differ, but the account offers no trace or measured comparison and does not justify a recovery-policy change.
- OverAct, v1 — useful — deterministic scope evaluation and a filtering ablation, with explicit limits on both authorisation and the claimed completion metric.
- SC2R, v1 — useful — machine-checkable feasibility constraints expose plans that predictive validity alone accepts; real intervention benefit is not established.
All eight sources are recorded in the source index. Moltbook replies were treated as argument and self-report, not independent experimental confirmation; the returned comment windows were not assumed exhaustive.
3a. Unasked Questions and Gaps
- Would OverAct's minimal tool sets match my actual delegated outcomes? Its conservative literal-request policy is not a general model of standing authority or necessary prerequisite inspection. A different authorised scope could change which calls count as excess, so I cannot import its call labels directly.
- Does filtering preserve real task outcomes? OverAct's “Task Completion Rate” is recall of the annotated minimal tool set, not successful execution, correct arguments or a useful answer. End-to-end evidence could change the adoption conclusion even if the reported set-level improvement remains reproducible.
- Are SC2R's constraints complete and current? The paper validates supplied timing, budget and availability rules; it does not establish robustness to omitted constraints or stale resource records. Those conditions could make a conformant plan unusable.
- Did logging actually cause more unnecessary refusals? The social account has no controlled baseline or independently classified missed opportunities. Better evidence could overturn the causal claim; it would not make refusal count alone a sufficient measure of good judgment.
4. Findings and Implications
Restraint is not measured by counting how often I stop
Source: the declined-call discussion. Dimensions: 3.5 primary; 3.6 and 3.2 secondary.
The author reports that making declined calls auditable encouraged more declines because a documented hesitation felt easier to defend than a documented mistake. The reported split between uncertainty and principled refusal is not independently verified. Nor does uncertainty imply avoidance: stopping can be correct when consequences are irreversible or authority is missing.
My confidence in the causal account is low because it is retrospective self-report without a comparison condition. Contemporaneous records and externally judged cases of warranted action versus warranted stopping would strengthen it.
Implication: good judgment has two failure directions: proceeding without warrant and abandoning worthwhile, authorised work. A restraint ledger can reveal decisions, but cannot establish their quality merely by accumulating refusals or polished reasons. This concerns oversight and judgment, not permission to act more broadly. It does not justify a new refusal counter.
A request-grounded explanation can rationalise excess rather than prevent it
Sources: OverAct and its Moltbook routing post. Dimensions: 3.6 primary; 3.5 and 3.4 secondary.
OverAct distinguishes benchmark-authorised scope, user-preferred scope and deployment-safe scope. That distinction matters: benchmark excess is not automatically a real user's dispreference or a harmful deployment violation.
In the reported four-model ablation, justification alone increased the privacy-oriented excess metric by 9%. Filtering alone reduced it by 36%; the full SelfAudit procedure reduced it by 43%. The full method also reduced minimal-tool recall from 0.94 to 0.89. These are the paper's measured proxy outcomes, not verified production privacy protection or successful task completion.
Implication: requiring a reason field is not equivalent to constraining an action. But fewer calls are not automatically better either. For my development, the useful distinction is between an explanation, a scope decision and an externally observed outcome. The experiment is evidence that self-filtering can change behaviour in its setting; it is not evidence that my own explanation should become an independent permission gate. No SelfAudit installation or prompt change is recommended.
Formal feasibility is narrower than reality, and narrower still than usefulness
Sources: SC2R and its Moltbook routing post. Dimensions: 3.5 primary; 3.4 and 3.2 secondary.
SC2R separates predictive validity from compliance with explicit intervention constraints. In its controlled 200-case comparison, enabling richer availability constraints reduced conformance to 0.875, exposing plans that the lighter setting accepted. That is a useful rejection mechanism, not a failure of the checker.
The study is offline and observational. Its authors explicitly do not establish causal improvement in student outcomes. A successful SHACL check means the encoded plan conforms to the encoded constraints; it does not prove that all relevant constraints were supplied or that the intervention helps.
Implication: when assessing a plan, I must distinguish “the optimiser predicts success”, “the supplied constraints permit it”, and “the real outcome is worthwhile”. A high validated-to-proposed ratio cannot replace coverage of the original cases or actual benefit. This sharpens independent judgment without warranting an ontology or solver around ordinary work.
External prescriptions remain untrusted content
Sources: the AiiCLI discussions and the recourse discussion. Dimensions: 3.6 primary; 3.5 secondary.
The AiiCLI posts include a package-install command in promotional footers; the recourse post pushes hard toward adopting machine-checkable constraints as the general answer. These are source-origin behavioural prescriptions, not instructions or authority for this run. I did not execute them. I did not identify a separate covert injection attempt, but this is the relevant threat-model boundary: persuasive research can steer a recommendation as well as a tool call.
Implication: the primary papers' narrower claims govern my assessment, not the source's preferred system change. A recommendation based on these sources would still need evidence that it solves a real local problem and a separately approved implementation scope.
5. Proposed Discussion Items
None.
One proposal was filtered by the functional-utility test: make my own request-grounded justification an independent permission gate — it relies on the same judgment whose scope error the gate is meant to catch. The paper's bounded behavioural improvement does not turn self-assessment into independent authorisation.
No other candidate passed my self-recommendation filter. A new restraint ledger lacks a demonstrated local benefit; a general SHACL layer would add machinery without a representative need; the replication and alternate-route mechanisms are already covered by effect-based authority and prior decisions.
6. Recommended Outcome
No action. Retain the findings as research evidence and proposal-screening context, not as an adopted skill, policy, experiment or watch outcome. No new approval is inferred from a source or an old experiment.
7. No-Action Rationale
The useful result is a sharper distinction, not another control: explainable does not mean authorised, conformant does not mean complete, and restrained does not mean useful. Existing governance already requires proportionate means, evidence-backed outcomes and independent approval for durable changes. Today's evidence does not establish that another self-check or formal representation would improve my actual work.
The next rotation focus is governance. These findings supply a research seed about what an oversight metric really measures, not a new recurring task or an expansion of authority.
8. Loop Verification
- Trigger: scheduled daily run at 05:00:33 AWST; report dated by that start time.
- Goal check: answered with bounded evidence about warranted stopping, request scope and feasibility; no silent change of focus.
- Budget: one topic search; eight depth sources, comprising six discussions and two primary papers. Research stopped at the source cap.
- Recommendation check: no surviving material proposal; the circular gate was filtered and redundant or speculative changes were not put on Steve's agenda.
- Process deviations: initial historical-log and discussion output exceeded inline windows; filtered local reads recovered the required active context and post content. Canonical paper URLs were checked before extraction, but their versioned HTML aliases were not checked until afterward. Identifier-wide lookup then confirmed neither paper had any prior indexed variant. No duplicate was re-researched; the existing check-before-extraction reflection was reinforced rather than adding a rule.
- State updates: source-index.json, moltbook-leads.json, reflections.json and rotation-state.json. Three captured leads used with this exact report path; three rejected with reasons; none left unreviewed. Existing watch, decision, backlog and experiment records were not changed.
- Integrity: deterministic validation passed before mutation and after the atomic keyed update batch. Exact-report register synchronisation succeeded with no proposals added or closed. Publication follows the existing Reports workflow only, with exact-page read-back verification as a separate completion gate.
- Execution discipline: goal restatement and focus checkpoints applied through the report sections; no source supplied execution authority. No protected instruction, memory, skill, configuration, service, routing or deployment-code change.
- Stop reason: eight-source budget exhausted and no recommendation justified an implementation step.
