Evidence and reproduction

Status is a vector, not a badge

The release reports software behavior, numerical behavior, literature agreement, independent review, experimental comparison, and data pedigree separately. A passing test suite cannot silently promote a model into “validated.”

Current release: internal software and numerical checks passed for the declared cases. No independent scientific or experimental validation. External decisions remain pending until a named reviewer evaluates an immutable artifact for a stated intended use.

Required evidence dimensions

Allowed public states

These state names are controlled vocabulary. Details and basis live in the machine-readable registry.

DimensionAllowed statesQuestion answered
Software verificationnot tested · internal tests passed · independently reproducedDoes code behavior meet declared software requirements?
Numerical verificationnot assessed · convergence demonstrated · cross-solver agreement demonstratedHow do discretization, solver, and numerical error behave in the declared cases?
Literature reproductionnone · partial · reproduced within declared toleranceDoes an immutable result agree with a named publication or table inside a named domain?
Independent scientific reviewpending · changes requested · approved for declared useHas an independent reviewer approved the exact artifact and scope?
Experimental validationnone · pilot · validated within declared domainHow well does the model represent a controlled real-world referent for its intended use?
Data maturitysynthetic · public experimental · evaluated · partner-controlledWhat is the pedigree and custody state of model inputs or evaluation data?

Release snapshot

Evidence states by module

ModuleSoftwareNumericalLiteratureIndependent reviewExperimentData
FusionSiminternal tests passedconvergence demonstratedpartialpendingnoneevaluated
Nuclear Datainternal tests passednot assessedpartialpendingnoneevaluated
Mirror Reactorinternal tests passedconvergence demonstratednonependingnonesynthetic
Torus Orbitinternal tests passedconvergence demonstratednonependingnonesynthetic
AlphaTrackinternal tests passednot assessednonependingnonesynthetic
DirectConvertinternal tests passednot assessednonependingnonesynthetic

Reproduction surface

Artifacts shipped with this release

Contracts

Run and result identity

Versioned JSON Schemas, canonical JSON serialization, SHA-256 identifiers, stale-state invalidation, seeds, implementation hashes, and export packages.

RunSpec schema · ResultSpec schema

Research object

Portable release metadata

RO-Crate 1.3 metadata, CFF citation metadata, release notes, checksums, and SLSA-compatible provenance statement identify the uploaded artifact.

RO-Crate · CITATION.cff · Checksums

Verification ≠ validation

Intended use and domain come first

NASA model-and-simulation guidance distinguishes verification against requirements from validation against the real world for an intended use, and requires the validation domain to be recorded. This release applies that boundary consistently.