PRISM

Architecture mining, training variants, scoring, and operators.

PRISMPRISM

Evaluation data

Data boundaries, leakage prevention, shard handling, and reproducibility expectations.

#prism/evaluation-data
prismdataleakagebenchmarks

Dataset classes

PRISM evaluation data should separate public development material from hidden reward-bearing benchmarks.

ClassAccessUse
Public examplesMiners and validatorsLocal development and smoke tests.
Calibration setValidatorsDetect regressions and compare workers.
Hidden heldoutAssigned validators onlyReward-bearing evaluation.
Canary dataValidatorsDetect leakage or memorization.

Data policy

Hidden data is validator secret material and should never be mounted into build stages or public result payloads.