Entries
7
6 scored · 0 disqualified
Settled in
1h 29m
seated Sep 04, 12:38 UTC
Top score
0.7339
0 is baseline speed
Leader
Changed
won by 5b56ceb6…f33e0d
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader |
| 1e352cf…2a972 |
| scored |
| 0.7145 score breakdown |
| — |
| challenger | a71f40a…e14a5 | scored | 0.6906 score breakdown | — |
| challenger | eda7a6e…d15c1 | infra failedsla bench candidate-2 rep 1 had 32 failed request(s): candidate-2/rep1/hf-000: completions stream from http://172.18.0.2:8000/v1/completions: completion tokens=58 but only 10 inter-token gap(s) (expected at least 57; coalesced stream) | — score breakdown | — |
| challenger | 5b56ceb…33e0d | scored | 0.7339 score breakdown | — |
| challenger | 20416c8…6505f | scored | 0.718 score breakdown | — |
| challenger | 0388a8a…c39e4 | scored | 0.7263 score breakdown | — |
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Incumbent
2/2Loading weights and waiting for the server to answer.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Scorer
2/2Loading weights and waiting for the server to answer.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Teardown
1/1Destroying the pod and its volume.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Full workload replay against the latency gates.