Entries
7
6 scored · 0 disqualified
Settled in
1h 29m
seated Sep 04, 12:38 UTC
Top score
0.7339
0 is baseline speed
Leader
Changed
won by 5b56ceb6…f33e0d
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Incumbent
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Scorer
2/2Loading weights and waiting for the server to answer.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Teardown
1/1Destroying the pod and its volume.
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader | 1e352cf…2a972 | scored | 0.7145 score breakdown | — | ||
| challenger | a71f40a…e14a5 | scored | 0.6906 score breakdown | — | ||
| challenger | eda7a6e…d15c1 | infra failedsla bench candidate-2 rep 1 had 32 failed request(s): candidate-2/rep1/hf-000: completions stream from http://172.18.0.2:8000/v1/completions: completion tokens=58 but only 10 inter-token gap(s) (expected at least 57; coalesced stream) | — score breakdown | — | ||
| challenger | 5b56ceb…33e0d | scored | 0.7339 score breakdown | — | ||
| challenger | 20416c8…6505f | scored | 0.718 score breakdown | — | ||
| challenger | 0388a8a…c39e4 | scored | 0.7263 score breakdown | — |