Entries
7
2 scored · 2 disqualified
Settled in
2h 08m
seated Sep 18, 01:33 UTC
Top score
0.6079
0 is baseline speed
Leader
Changed
won by b5af9d17…f565c5
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader |
| 2411df5…e7995 |
| disqualifieddegenerate output (hf-029: answer: longest repeated span ratio 0.365 at or above harness ceiling over 301 chars) |
| — score breakdown |
| — |
| challenger | 56c44df…55af4 | infra failedsla bench candidate-1 rep 1 had 32 failed request(s): candidate-1/rep1/hf-000: completions request failed for http://172.18.0.2:8000/v1/completions: <urlopen error [Errno 111] Connection refused> | — score breakdown | — |
| challenger | 5ab4c50…2a54f | infra failedsla bench candidate-2 rep 1 had 32 failed request(s): candidate-2/rep1/hf-000: completions timed out for http://172.18.0.2:8000/v1/completions | — score breakdown | — |
| challenger | 479f0b7…34391 | disqualifieddegenerate output (hf-007: answer: longest repeated span ratio 0.621 at or above harness ceiling over 554 chars) | — score breakdown | — |
| challenger | b5af9d1…565c5 | scored | 0.6079 score breakdown | — |
| challenger | 6b1ce3a…355a5 | infra failedsla bench candidate-5 rep 1 had 32 failed request(s): candidate-5/rep1/hf-000: completions timed out for http://172.18.0.2:8000/v1/completions | — score breakdown | — |
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Incumbent
2/2Loading weights and waiting for the server to answer.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Scorer
2/2Loading weights and waiting for the server to answer.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Teardown
1/1Destroying the pod and its volume.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Full workload replay against the latency gates.