PRISM

Architecture mining, training variants, scoring, and operators.

PRISMPRISM

Evaluation pipeline

Validator pipeline from intake through schema checks, sandbox execution, benchmark scoring, consensus, and publication.

#prism/evaluation-pipeline
prismevaluationvalidatorspipeline

Stages

Every stage should emit structured status so miners can distinguish submission errors from infrastructure failures.

StageOutput
IntakeSubmission ID, hotkey, manifest hash, artifact inventory.
Static validationSchema, checksum, policy, dependency results.
BuildImage digest, install logs, model construction report.
Smoke testForward pass, memory estimate, observed metadata.
BenchmarkPer-task metrics, logs, resource usage.
ConsensusValidator agreement and outlier handling.
PublicationLeaderboard row and reward update.

Validator assignments

Reward-bearing submissions should be assigned to multiple validators and escalated when they change top ranks or ownership status.