Entries
7
1 scored · 4 disqualified
Settled in
2h 03m
seated Sep 01, 21:54 UTC
Top score
—
no scored challenger
Leader
Changed
a challenger took the lead
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader |
| 3fd4ee7…4959e |
| disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.056 below baseline 1.000 over 16682 chars) |
| — score breakdown |
| — |
| challenger | eb6fc6b…c94b7 | disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.062 below baseline 1.000 over 16311 chars) | — score breakdown | — |
| challenger | f4bfb0b…99c3d | infra failedp99 e2e ms rel range 16.4692 exceeds reproducibility bar 0.335 | — score breakdown | — |
| challenger | 976c05a…4c1b1 | disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.144 below baseline 1.000 over 16606 chars) | — score breakdown | — |
| challenger | d6f5107…a6eb9 | infra failedhealth check timed out after 1200.0s for http://172.18.0.2:8000/v1/models (last: [Errno 111] Connection refused); container log tail: fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use fast=True`, or `backend="pil"` instead of `use fast=False`. (EngineCore pid=293) Loading safetensors checkpoint shards: 0% Completed | 0/66 [00:00<?, ?it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 3% Completed | 2/66 [00:00<00:03, 19.22it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 6% Completed | 4/66 [00:00<00:03, 18.75it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 9% Completed | 6/66 [00:00<00:03, 18.48it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 12% Completed | 8/66 [00:00<00:03, 18.40it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 15% Completed | 10/66 [00:00<00:03, 18.25it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 18% Completed | 12/66 [00:00<00:02, 18.22it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 21% Completed | 14/66 [00:00<00:02, 18.09it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 24% Completed | 16/66 [00:00<00:02, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 27% Completed | 18/66 [00:00<00:02, 18.10it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 30% Completed | 20/66 [00:01<00:02, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 33% Completed | 22/66 [00:01<00:02, 17.91it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 36% Completed | 24/66 [00:01<00:02, 17.96it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 39% Completed | 26/66 [00:01<00:02, 17.88it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 42% Completed | 28/66 [00:01<00:02, 17.98it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 45% Completed | 30/66 [00:01<00:01, 18.03it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 48% Completed | 32/66 [00:01<00:01, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 52% Completed | 34/66 [00:01<00:01, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 55% Completed | 36/66 [00:01<00:01, 18.14it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 58% Completed | 38/66 [00:02<00:01, 18.15it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 61% Completed | 40/66 [00:02<00:01, 18.17it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 64% Completed | 42/66 [00:02<00:01, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 67% Completed | 44/66 [00:02<00:01, 18.18it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 70% Completed | 46/66 [00:02<00:01, 18.19it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 73% Completed | 48/66 [00:02<00:00, 18.21it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 76% Completed | 50/66 [00:02<00:00, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 79% Completed | 52/66 [00:02<00:00, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 82% Completed | 54/66 [00:02<00:00, 18.08it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 85% Completed | 56/66 [00:03<00:00, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 88% Completed | 58/66 [00:03<00:00, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 91% Completed | 60/66 [00:03<00:00, 18.05it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 94% Completed | 62/66 [00:03<00:00, 18.04it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 97% Completed | 64/66 [00:03<00:00, 18.03it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 100% Completed | 66/66 [00:04<00:00, 6.98it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 100% Completed | 66/66 [00:04<00:00, 15.62it/s] (EngineCore pid=293) | — score breakdown | — |
| challenger | ef4eee5…e48b7 | disqualifieddegenerate output (hf-023: distinct 16-gram ratio 0.010 below baseline 1.000 over 28339 chars) | — score breakdown | — |
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Incumbent
2/2Loading weights and waiting for the server to answer.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Scorer
2/2Loading weights and waiting for the server to answer.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Teardown
1/1Destroying the pod and its volume.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
Full workload replay against the latency gates.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Full workload replay against the latency gates.