Entries
7
4 scored · 2 disqualified
Settled in
3h 45m
seated Sep 01, 18:07 UTC
Top score
0.0735
0 is baseline speed
Leader
Changed
won by 3fd4ee7c…c4959e
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader |
| 37c3396…8ac17 |
| disqualifiedtoken logprob at quantile 0.001 is -13.125, below -12.0 |
| — score breakdown |
| — |
| challenger | 51416ca…c6dd6 | scored | -0.0669 score breakdown | — |
| challenger | 6c7a8f7…382f9 | scored | -0.0994 score breakdown | — |
| challenger | eb6fc6b…c94b7 | infra failedp99 e2e ms rel range 6.2272 exceeds reproducibility bar 0.335 | — score breakdown | — |
| challenger | 3fd4ee7…4959e | scored | 0.0735 score breakdown | — |
| challenger | 296f9d1…91694 | disqualifieddegenerate output (hf-027: longest repeated span ratio 0.809 above baseline 0.056 over 1125 chars) | — score breakdown | — |
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Incumbent
2/2Loading weights and waiting for the server to answer.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Scorer
2/2Loading weights and waiting for the server to answer.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Teardown
1/1Destroying the pod and its volume.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Full workload replay against the latency gates.