015-per-case-bundle-failures
Per-case reporting of unusable replay bundles (amends 004)
Lifecycle approvedImplementation completeVerification unknownQualification unknown
An amendment of approved spec 004 (R-16). Evaluation takes parsed replay bundles only, so a retained bundle whose bytes cannot be read, exceed their limit or do not parse cannot be reported as one incomparable case: a host must either stop the whole evaluation (the CLI's choice, spec 006 E-31) or leave the case out, which the library then reports as `bundle-missing`, misstating corruption as absence. This amendment lets the caller supply a typed bundle-load failure per case, reported as incomparable with its own reason, counted in coverage and excluded from quality. Approved (A-11, 2026-09-25) and implemented.
Read the full pinned specification ↗Relationships
depends on
Claimed units
- extends
{ "nature": "amending", "spec": "004-evaluation-and-replay", "unit": { "kind": "directory", "path": "crates/rustev-eval/" } } - extends
{ "nature": "amending", "spec": "006-cli-surface", "unit": { "kind": "directory", "path": "crates/rustev-cli/" } } - extends
{ "nature": "additive", "spec": "001-boundaries-and-authority", "unit": { "kind": "file", "path": "Makefile" } }
Source headings
- 015: Per-case reporting of unusable replay bundles (amends 004)
- 1. Purpose
- 2. Territory
- 3. Behavior
- 3.1 Bundle inputs
- 3.2 Reporting
- 3.3 The CLI
- 3.4 Compatibility
- 4. Out of scope
- 5. Observable negative cases
- Acceptance
- Open questions
- Implementation record
- Verification
Frozen anchors
No frozen anchors declared.