Round score
0.302
+30.20%
Prompts scored
22 / 32
median_e2e_speedup
Below tolerance
10
answered too little to score
Zeroed total
10
scored 0.0 without measuring
The round score is the scoring rule applied to the prompts below. Both engines are compared at the same output token count, so a candidate that stops early cannot buy speed by answering less: a prompt under the tolerance bar scores nothing and shows its gate reason.
32 prompts
| Prompt | Speedup | Baseline | Candidate | Tokens | Gate |
|---|---|---|---|---|---|
| hf-000 | +52.74% | 1.384s | 0.654s | 16 | — |
| hf-001 | +75.15% | 4.006s | 0.995s | 42 | — |
| hf-003 | +83.24% | 3.456s | 0.579s |
32 requests
| Request | TTFT | Total | Tokens | Slowest gap | Stream |
|---|---|---|---|---|---|
| hf-000 | 187.75ms | 0.796s | 21 | 213.44ms | — |
| hf-001 | 459.55ms | 0.995s | 42 | 146.37ms | — |
| hf-002 | 403.75ms | 0.830s |
verdict
evidence
min logprob
num prompts
mean logprob
coverage ratio
quantile logprob
num positions scored
role
| 29 |
| — |
| hf-004 | +84.77% | 3.836s | 0.584s | 43 | — |
| hf-005 | — | — | — | 29 | candidate output below tolerance |
| hf-002 | +83.60% | 5.063s | 0.830s | 49 | — |
| hf-015 | — | — | — | 24 | candidate output below tolerance |
| hf-007 | +64.25% | 5.148s | 1.841s | 40 | — |
| hf-010 | +47.72% | 4.744s | 2.480s | 57 | — |
| hf-006 | +64.02% | 5.273s | 1.897s | 49 | — |
| hf-009 | — | — | — | 28 | candidate output below tolerance |
| hf-020 | +43.31% | 2.682s | 1.520s | 28 | — |
| hf-011 | +46.83% | 4.442s | 2.362s | 43 | — |
| hf-008 | +45.28% | 5.016s | 2.745s | 44 | — |
| hf-013 | — | — | — | 28 | candidate output below tolerance |
| hf-023 | +29.03% | 2.079s | 1.475s | 22 | — |
| hf-012 | +46.04% | 4.249s | 2.293s | 42 | — |
| hf-017 | +43.48% | 3.381s | 1.911s | 42 | — |
| hf-018 | +24.93% | 3.175s | 2.383s | 40 | — |
| hf-021 | +15.18% | 2.705s | 2.294s | 42 | — |
| hf-025 | +20.96% | 1.956s | 1.546s | 42 | — |
| hf-027 | +22.56% | 1.583s | 1.226s | 46 | — |
| hf-026 | — | — | — | 29 | candidate output below tolerance |
| hf-014 | +29.85% | 4.173s | 2.927s | 61 | — |
| hf-019 | +30.55% | 3.215s | 2.233s | 57 | — |
| hf-030 | — | — | — | 14 | candidate output below tolerance |
| hf-024 | — | — | — | 24 | candidate output below tolerance |
| hf-031 | +46.74% | 0.832s | 0.443s | 43 | — |
| hf-022 | — | — | — | 25 | candidate output below tolerance |
| hf-029 | +33.58% | 1.242s | 0.825s | 46 | — |
| hf-016 | — | — | — | 48 | candidate output below tolerance |
| hf-028 | — | — | — | 45 | candidate output below tolerance |
| 49 |
| 146.52ms |
| — |
| hf-003 | 218.33ms | 0.579s | 29 | 145.82ms | — |
| hf-004 | 198.84ms | 0.584s | 43 | 152.62ms | — |
| hf-005 | 197.01ms | 0.437s | 29 | 151.52ms | — |
| hf-006 | 198.53ms | 1.897s | 49 | 256.42ms | — |
| hf-007 | 456.82ms | 1.841s | 40 | 256.58ms | — |
| hf-008 | 487.11ms | 2.745s | 44 | 217.52ms | — |
| hf-009 | 474.31ms | 1.647s | 28 | 254.05ms | — |
| hf-010 | 482.97ms | 2.480s | 57 | 255.61ms | — |
| hf-011 | 529.94ms | 2.570s | 46 | 217.42ms | — |
| hf-012 | 489.36ms | 2.293s | 43 | 211.10ms | — |
| hf-013 | 496.38ms | 1.673s | 28 | 209.61ms | — |
| hf-014 | 440.56ms | 2.927s | 61 | 212.22ms | — |
| hf-015 | 505.77ms | 1.768s | 24 | 217.51ms | — |
| hf-016 | 516.81ms | 2.420s | 48 | 219.65ms | — |
| hf-017 | 459.69ms | 1.911s | 43 | 209.03ms | — |
| hf-018 | 534.17ms | 2.383s | 40 | 217.81ms | — |
| hf-019 | 442.93ms | 2.435s | 79 | 213.61ms | — |
| hf-020 | 483.82ms | 1.935s | 43 | 210.98ms | — |
| hf-021 | 492.25ms | 2.294s | 42 | 212.34ms | — |
| hf-022 | 495.02ms | 1.329s | 25 | 211.91ms | — |
| hf-023 | 502.82ms | 1.475s | 22 | 208.01ms | — |
| hf-024 | 513.78ms | 1.693s | 24 | 212.33ms | — |
| hf-025 | 516.19ms | 1.546s | 42 | 217.10ms | — |
| hf-026 | 531.22ms | 1.329s | 29 | 207.94ms | — |
| hf-027 | 532.32ms | 1.243s | 56 | 211.60ms | — |
| hf-028 | 480.59ms | 1.024s | 45 | 208.71ms | — |
| hf-029 | 484.52ms | 0.825s | 48 | 209.13ms | — |
| hf-030 | 547.68ms | 0.598s | 14 | 17.96ms | — |
| hf-031 | 308.57ms | 0.443s | 43 | 23.83ms | — |
evidence
requests per s
sla goodput ratio
output tokens per s
p99 e2e ms rel range
p99 itl ms rel range
p99 ttft ms rel range
Image digest
Patch hash