Entries
7
1 scored · 4 disqualified
Settled in
2h 03m
seated Sep 01, 21:54 UTC
Top score
—
no scored challenger
Leader
Changed
a challenger took the lead
23/23 steps
Setup
4/4Waiting on a provider to hand over a machine.
Installing the harness and shipping the repo.
Fetching the baseline and candidate engine images.
Staging the campaign model onto the pod.
Baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Incumbent
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 1 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 2 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 3 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 4 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Candidate 5 of 5
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Scorer
2/2Loading weights and waiting for the server to answer.
The pinned baseline image teacher-forces captured outputs against the campaign thresholds.
Drift baseline
2/2Loading weights and waiting for the server to answer.
Full workload replay against the latency gates.
Teardown
1/1Destroying the pod and its volume.
7
| Role | Miner | Patch | Status | Score | Duration | Open |
|---|---|---|---|---|---|---|
| baseline | — | — | scored | 0 score breakdown | — | |
| leader | 3fd4ee7…4959e | disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.056 below baseline 1.000 over 16682 chars) | — score breakdown | — | ||
| challenger | eb6fc6b…c94b7 | disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.062 below baseline 1.000 over 16311 chars) | — score breakdown | — | ||
| challenger | f4bfb0b…99c3d | infra failedp99 e2e ms rel range 16.4692 exceeds reproducibility bar 0.335 | — score breakdown | — | ||
| challenger | 976c05a…4c1b1 | disqualifieddegenerate output (hf-017: distinct 16-gram ratio 0.144 below baseline 1.000 over 16606 chars) | — score breakdown | — | ||
| challenger | d6f5107…a6eb9 | infra failedhealth check timed out after 1200.0s for http://172.18.0.2:8000/v1/models (last: [Errno 111] Connection refused); container log tail: fast` parameter is deprecated and will be removed in a future version. Use `backend="torchvision"` instead of `use fast=True`, or `backend="pil"` instead of `use fast=False`. (EngineCore pid=293) Loading safetensors checkpoint shards: 0% Completed | 0/66 [00:00<?, ?it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 3% Completed | 2/66 [00:00<00:03, 19.22it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 6% Completed | 4/66 [00:00<00:03, 18.75it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 9% Completed | 6/66 [00:00<00:03, 18.48it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 12% Completed | 8/66 [00:00<00:03, 18.40it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 15% Completed | 10/66 [00:00<00:03, 18.25it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 18% Completed | 12/66 [00:00<00:02, 18.22it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 21% Completed | 14/66 [00:00<00:02, 18.09it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 24% Completed | 16/66 [00:00<00:02, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 27% Completed | 18/66 [00:00<00:02, 18.10it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 30% Completed | 20/66 [00:01<00:02, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 33% Completed | 22/66 [00:01<00:02, 17.91it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 36% Completed | 24/66 [00:01<00:02, 17.96it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 39% Completed | 26/66 [00:01<00:02, 17.88it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 42% Completed | 28/66 [00:01<00:02, 17.98it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 45% Completed | 30/66 [00:01<00:01, 18.03it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 48% Completed | 32/66 [00:01<00:01, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 52% Completed | 34/66 [00:01<00:01, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 55% Completed | 36/66 [00:01<00:01, 18.14it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 58% Completed | 38/66 [00:02<00:01, 18.15it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 61% Completed | 40/66 [00:02<00:01, 18.17it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 64% Completed | 42/66 [00:02<00:01, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 67% Completed | 44/66 [00:02<00:01, 18.18it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 70% Completed | 46/66 [00:02<00:01, 18.19it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 73% Completed | 48/66 [00:02<00:00, 18.21it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 76% Completed | 50/66 [00:02<00:00, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 79% Completed | 52/66 [00:02<00:00, 18.16it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 82% Completed | 54/66 [00:02<00:00, 18.08it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 85% Completed | 56/66 [00:03<00:00, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 88% Completed | 58/66 [00:03<00:00, 18.12it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 91% Completed | 60/66 [00:03<00:00, 18.05it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 94% Completed | 62/66 [00:03<00:00, 18.04it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 97% Completed | 64/66 [00:03<00:00, 18.03it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 100% Completed | 66/66 [00:04<00:00, 6.98it/s] (EngineCore pid=293) Loading safetensors checkpoint shards: 100% Completed | 66/66 [00:04<00:00, 15.62it/s] (EngineCore pid=293) | ||||
| challenger | ef4eee5…e48b7 | disqualifieddegenerate output (hf-023: distinct 16-gram ratio 0.010 below baseline 1.000 over 28339 chars) | — score breakdown | — |
| — score breakdown |
| — |