PRISMPRISM
Evaluation data
Data boundaries, leakage prevention, shard handling, and reproducibility expectations.
prismdataleakagebenchmarks
Sources
Dataset classes
PRISM evaluation data should separate public development material from hidden reward-bearing benchmarks.
| Class | Access | Use |
|---|---|---|
| Public examples | Miners and validators | Local development and smoke tests. |
| Calibration set | Validators | Detect regressions and compare workers. |
| Hidden heldout | Assigned validators only | Reward-bearing evaluation. |
| Canary data | Validators | Detect leakage or memorization. |
Data policy
Hidden data is validator secret material and should never be mounted into build stages or public result payloads.