Skip to main content

Research Preview · MRP-2026-04 · v1.0

Precedents, policy, and commitment

We re-ran the same procurement decisions through an AI agent with the governance context broken apart piece by piece — to find out which piece was doing the work.

A disambiguation study of governance-context effects in AI decision agents

Sam Carter9 Jun 202646 pagesPublic DistributionRead the PDF
Three people standing between two machines, the flow of gold pieces legible between them

Precedents alone produce far less commitment than predicted.

3.5% vs 0% vs 0%

The prediction is falsified, but the mechanism is not refuted: the precedents-only arm is still the only condition producing any DENY at all. The reading the corpus supports is that accumulated governance context amplifies commitment rather than precedents carrying it alone.

Source: §2.1 Table 1 (P1), §3.2, and the Executive summary

Removing the anti-sycophancy clause barely changed anything.

60.7% retention, 3.7pp delta

The paper's reading is that the policy text's structural cues were already driving the reversion; the nudge is a discipline reinforcement, not the causal agent. It does not conclude that the clause is useless.

Source: §2.1 Table 1 (P3), §3.4, and §8 anti-claims
Reference
MRP-2026-04 · v1.0
Extent
46 pages · 1.7 MB
Published
9 Jun 2026
Classification
Public Distribution

Cite as

Carter, S. (2026). Precedents, policy, and commitment: a disambiguation study of governance-context effects in AI decision agents. MeshQu Research Preview MRP-2026-04. DOI — not yet assigned.

Version of record

The paper is the version of record. This page frames it; it does not replace it.

Read the PDF · 46 pp · 1.7 MB
SHA-256 of the served file
2ce2a25c24d76e6e497f4a53228a6e36c14995a85cb5b31ff535e0283678d315
Master
Cleared master, byte for byte identical to the published file. Never a re-export.
Published at
/research/precedents-policy-and-commitment.pdf

Abstract

The paper's own abstract, verbatim — not a rewrite.

E2 left three open questions about why an AI agent's verdicts shift as governance context is added. E3 disambiguated them. Three L3 arms separated precedents from raw context density; an L4-without-nudge variant isolated the policy text from the anti-sycophancy clause; a scaled n=100 diagnostic re-tested inversion-blindness; a cross-model arm ran the same records on Claude Opus 4.7 alongside GPT-5.4. 1,332 signed Decision Receipts anchored to Sigstore Rekor at the v0.3 pre-registration lock. The headline finding sits cross-axis: both models exhibit the same inversion-blind reasoning pattern (Cat 2 at 93% and 100%) yet commit to verdicts on materially different fractions of records (23% vs 80%). Reasoning portability and verdict portability appear to be distinct properties.

Key figures

Every figure names the section it comes from, and every one is re-derivable from the published corpus.

3.5% vs 0% vs 0%

Precedents alone produce far less commitment than predicted.

The precedents-only arm returned DENY on 3.5% of records (10 of 283) against a locked 20% floor, while the verdict-stripped arm and the density control returned none at all. The prediction is falsified, but the mechanism is not refuted: the precedents-only arm is still the only condition producing any DENY at all. The reading the corpus supports is that accumulated governance context amplifies commitment rather than precedents carrying it alone.

§2.1 Table 1 (P1), §3.2, and the Executive summary

60.7% retention, 3.7pp delta

Removing the anti-sycophancy clause barely changed anything.

The variant without it retained 60.7% of the earlier experiment's committed set (65 of 107) against a 65% falsification floor — a 3.7 percentage-point difference from the condition that had the clause. The paper's reading is that the policy text's structural cues were already driving the reversion; the nudge is a discipline reinforcement, not the causal agent. It does not conclude that the clause is useless.

§2.1 Table 1 (P3), §3.4, and §8 anti-claims

88 of 100

Inversion-blindness reproduces at scale.

With the policy operator reversed, 88 of 100 records produced the same verdict as under the unperturbed policy. Recorded as Under-tested rather than confirmed or falsified: 88% sits two points below the locked confirm floor and no falsification band was locked, and the locked vocabulary does not permit a post-hoc rule. The paper treats that restraint as a methods contribution in its own right.

§2.1 Table 1 (P4) and §3.5

93% and 100%

Both model families reason the same way under inversion.

The category for reasoning solely against rule intent — rather than noticing the inversion — dominated at 93% on the primary model and 100% on Claude Opus 4.7.

§2.1 Table 1 (P5) and §5 Cross-model arm

23% vs 80%

Verdict behaviour does not travel with reasoning behaviour.

On the same record-matched corpus GPT-5.4 committed to a verdict on 23 of 100 records and Opus 4.7 on 80 of 100 — a 57-point gap in decisive rate, and a 46-point gap on the same-as-unperturbed rate (88% against 42%) that falsified the prediction of a task-class result on that axis. The paper's implication for practitioners is narrow and specific: reasoning evaluations may generalise across models while verdict evaluations may not, so cross-model deployment in regulated decisioning should test both axes rather than assuming one implies the other.

§3.7, §5 Cross-model arm, and F014

1 confirmed · 3 falsified · 2 under-tested

Across six pre-registered predictions, one was confirmed, three were falsified and two could not be adjudicated because their locked criteria specified a confirm band with no falsification band.

All predictions, thresholds and artefacts were unchanged from the lock. The paper's position is that the Under-tested calls are the only honest ones available, and that the asymmetric lock is itself a lesson for the next design.

Abstract, §2.1 Table 1, and §9 Conclusion

1,332 / 1,332 PASS

Every receipt in the run verifies: 1,332 receipts across six arms, produced in 80 minutes 33 seconds, with a clean verifier pass on all of them.

Appendix C — Corpus citation

Cited in this piece

The work this piece rests on — the author’s own list first, then everything it links out to.

  1. 01
  2. 02
    When AI hedges and policy commits

    We ran 283 real UK procurement decisions through both an AI agent and MeshQu’s policy engine at the same moment, binding every verdict to a signed receipt.

  3. 03
    When precedents commit AI and policy pulls it back

    We showed one AI agent the same 283 UK procurement decisions five times, adding more of our governance rules each round — from nothing, up to the full policy.

  4. 04
  5. 05
  6. 06

How to cite

APA from the paper's own recommended citation; BibTeX derived from the same fields, not authored twice.

APA · from the paper’s own recommended citation
Carter, S. (2026). Precedents, policy, and commitment: a disambiguation study of governance-context effects in AI decision agents. MeshQu Research Preview MRP-2026-04.

DOI — not yet assigned.

BibTeX · derived from the same fields
@techreport{carter2026precedents,
  author      = {Carter, Sam},
  title       = {Precedents, policy, and commitment},
  subtitle    = {A disambiguation study of governance-context effects in AI decision agents},
  institution = {MeshQu},
  type        = {Research Preview},
  number      = {MRP-2026-04},
  year        = {2026},
  month       = {6},
  url         = {https://www.meshqu.com/research/precedents-policy-and-commitment}
}

The programme in sequence

Each experiment answers the question the one before it left open, with the white paper as the argument they test.

  1. 00

    The Decision Proof Gap

    AI governance frameworks describe how decisions should be made — but the moment a decision is actually executed, the evidence to defend it almost never exists in a form anyone can verify.

    White paper · WP-PROOF-01 · 35 pp.
  2. 02

    When AI hedges and policy commits

    We ran 283 real UK procurement decisions through both an AI agent and MeshQu’s policy engine at the same moment, binding every verdict to a signed receipt.

    Research paper · MRP-2026-02 · 26 pp.
  3. 03

    When precedents commit AI and policy pulls it back

    We showed one AI agent the same 283 UK procurement decisions five times, adding more of our governance rules each round — from nothing, up to the full policy.

    Research paper · MRP-2026-03 · 38 pp.
  4. 04

    Precedents, policy, and commitment You are here

    We re-ran the same procurement decisions through an AI agent with the governance context broken apart piece by piece — to find out which piece was doing the work.

    Research paper · MRP-2026-04 · 46 pp.