statecraft.
Catalog/rustev

061-host-scored-repeat-sets

Host-scored repeat sets for the selection gate (amends 029 and 041)

Lifecycle approvedImplementation completeVerification unknownQualification unknown

A proposed amendment of approved specs 029 and 041 (and of spec 006's command table through 029 3.13), for release 0.4.1. Today `rustev gate select` reads only repeat sets Rustev evaluated itself: every run is a spec 004 evaluation of a Rustev plan over a Rustev dataset manifest. A host whose baseline and candidate runs execute in its own runtime, and whose outputs are scored through `scoreViews` into `rustev.scores/1`, has no supported way in. This spec adds a host run record (`rustev.host-run/1`) carrying host dataset, flow, version and run identities with per-case outcomes, latency and cost; an import command, `rustev eval repeat import`, that verifies the host's views and scores and builds a host repeat set with spec 029's statistics; a host baseline; and selection over host sets. Host documents have their own schema names, so no existing document changes bytes or meaning and a host set can never be compared with a Rustev-evaluated one. Every figure is labeled host-asserted. Ratified (A-77) for release 0.4.1.

Read the full pinned specification ↗

Relationships

Claimed units

  • extends
    {
  "nature": "amending",
  "spec": "004-evaluation-and-replay",
  "unit": {
    "kind": "directory",
    "path": "crates/rustev-eval/"
  }
}
  • extends
    {
  "nature": "amending",
  "spec": "006-cli-surface",
  "unit": {
    "kind": "directory",
    "path": "crates/rustev-cli/"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "031-public-api-and-release-family",
  "unit": {
    "kind": "directory",
    "path": "tools/rustev-release/"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "001-boundaries-and-authority",
  "unit": {
    "kind": "file",
    "path": "Makefile"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "001-boundaries-and-authority",
  "unit": {
    "kind": "directory",
    "path": "scripts/acceptance/"
  }
}

Source headings

  1. 061: Host-scored repeat sets for the selection gate (amends 029 and 041)
  2. 1. Purpose
  3. 2. Territory
  4. 2.1 Binding principles
  5. 3. Behavior
  6. 3.1 The host run record
  7. 3.2 Import: `rustev eval repeat import`
  8. 3.3 Measures
  9. 3.4 Statistics, sources and bands
  10. 3.5 Derivation, lineage and labels
  11. 3.6 Provenance separation
  12. 3.7 Host baselines and selection
  13. 3.8 Held-out splits
  14. 3.9 Exit codes
  15. 3.10 Library and bindings
  16. 4. Out of scope
  17. 5. Observable negative cases
  18. Acceptance
  19. Verification
  20. Implementation record
  21. Decisions at approval

Frozen anchors

No frozen anchors declared.