Entries
7
5 scored · 1 disqualified
Settled in
1h 19m
seated Sep 03, 22:32 UTC
Top score
0.6119
0 is baseline speed
Leader
Held
incumbent kept the lead
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Incumbent
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Scorer
2/2Loading weights and waiting for the server to answer.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Teardown
1/1Destroying the pod and its volume.
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader | fe6f11b…6f56c | scored | 0.6222 score breakdown | — | ||
| challenger | 85d6314…6de95 | scored | 0.1747 score breakdown | — | ||
| challenger | c062266…69fac | scored | 0.6119 score breakdown | — | ||
| challenger | f036451…e048d | infra failedp99 e2e ms rel range 6.4135 exceeds reproducibility bar 0.335 | — score breakdown | — | ||
| challenger | a319118…bd68c | scored | 0.5653 score breakdown | — | ||
| challenger | 5f296ca…ac5dc | disqualifiedtoken logprob at quantile 0.001 is -14.597, below -12.0 | — score breakdown | — |