statecraft.
Catalog/rustev

004-evaluation-and-replay

Evaluation and replay

Lifecycle approvedImplementation completeVerification unknownQualification unknown

Increment 2: offline reproduction from bounded, host-retained replay bundles; configurable tenant-only or principal-scoped equivalence for candidate comparison; explicit availability, coverage and abstention; named dataset splits and temperature fitting. Amends 002 with replay and request documents and typed loading diagnostics, and 003 with opt-in bounded capture of supplied values. Live re-execution is deferred. Synthetic fixtures establish mechanics only, never empirical quality.

Read the full pinned specification ↗

Relationships

Claimed units

  • establishes
    {
  "kind": "directory",
  "path": "crates/rustev-eval/"
}
  • extends
    {
  "nature": "amending",
  "spec": "002-decision-contract-and-pure-core",
  "unit": {
    "kind": "directory",
    "path": "crates/rustev-contract/"
  }
}
  • extends
    {
  "nature": "amending",
  "spec": "002-decision-contract-and-pure-core",
  "unit": {
    "kind": "directory",
    "path": "crates/rustev-core/"
  }
}
  • extends
    {
  "nature": "amending",
  "spec": "003-runtime-execution-and-evidence",
  "unit": {
    "kind": "directory",
    "path": "crates/rustev-runtime/"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "001-boundaries-and-authority",
  "unit": {
    "kind": "file",
    "path": "Cargo.toml"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "001-boundaries-and-authority",
  "unit": {
    "kind": "file",
    "path": "Cargo.lock"
  }
}
  • extends
    {
  "nature": "additive",
  "spec": "001-boundaries-and-authority",
  "unit": {
    "kind": "file",
    "path": "Makefile"
  }
}

Source headings

  1. 004: Evaluation and replay
  2. 1. Purpose
  3. 2. Territory
  4. 3. Behavior
  5. 3.1 Storage, scope and retention
  6. 3.2 Replay bundle, `rustev.replay/1`
  7. 3.3 Historical reproduction
  8. 3.4 Request identity and candidate comparison
  9. 3.5 Datasets, metrics and regression gates
  10. 3.6 Calibration fitting
  11. 4. Out of scope
  12. 5. Amendments and compatibility
  13. 6. Delivery sequence and acceptance
  14. Verification
  15. Implementation record
  16. Tooling compatibility record (2026-10-02)

Frozen anchors

No frozen anchors declared.