Round score
0.3699
+36.99%
Prompts scored
23 / 32
median_e2e_speedup
Below tolerance
9
answered too little to score
Zeroed total
9
scored 0.0 without measuring
The round score is the scoring rule applied to the prompts below. Both engines are compared at the same output token count, so a candidate that stops early cannot buy speed by answering less: a prompt under the tolerance bar scores nothing and shows its gate reason.
32 prompts
| Prompt | Speedup | Baseline | Candidate | Tokens | Gate |
|---|---|---|---|---|---|
| hf-001 | +42.45% | 0.396s | 0.228s | 18 | — |
| hf-000 | +50.37% | 0.740s | 0.367s | 40 | — |
| hf-002 | +25.58% | 0.528s | 0.393s |
32 requests
| Request | TTFT | Total | Tokens | Slowest gap | Stream |
|---|---|---|---|---|---|
| hf-000 | 151.10ms | 0.368s | 47 | 89.13ms | — |
| hf-001 | 141.92ms | 0.228s | 18 | 26.28ms | — |
| hf-002 | 174.79ms | 0.457s |
verdict
evidence
min logprob
num prompts
mean logprob
coverage ratio
quantile logprob
num positions scored
role
| 28 |
| — |
| hf-003 | — | — | — | 32 | candidate output below tolerance |
| hf-004 | +25.30% | 0.765s | 0.572s | 41 | — |
| hf-005 | — | — | — | 27 | candidate output below tolerance |
| hf-006 | — | — | — | 31 | candidate output below tolerance |
| hf-007 | +47.24% | 0.778s | 0.410s | 41 | — |
| hf-008 | +45.86% | 0.865s | 0.468s | 42 | — |
| hf-009 | +53.76% | 0.775s | 0.358s | 41 | — |
| hf-010 | — | — | — | 24 | candidate output below tolerance |
| hf-011 | +51.60% | 0.768s | 0.372s | 46 | — |
| hf-012 | +54.34% | 0.565s | 0.258s | 34 | — |
| hf-013 | +49.62% | 0.739s | 0.372s | 40 | — |
| hf-014 | +21.29% | 0.723s | 0.569s | 42 | — |
| hf-015 | +30.20% | 0.821s | 0.573s | 47 | — |
| hf-017 | -18.30% | 0.486s | 0.575s | 28 | — |
| hf-016 | +54.26% | 0.910s | 0.416s | 51 | — |
| hf-018 | — | — | — | 48 | candidate output below tolerance |
| hf-019 | +56.60% | 1.002s | 0.435s | 50 | — |
| hf-020 | +54.97% | 0.941s | 0.424s | 40 | — |
| hf-022 | +43.62% | 0.612s | 0.345s | 24 | — |
| hf-023 | +65.91% | 1.017s | 0.347s | 46 | — |
| hf-021 | +59.49% | 1.020s | 0.413s | 45 | — |
| hf-024 | +33.66% | 1.017s | 0.675s | 47 | — |
| hf-025 | +40.31% | 1.015s | 0.606s | 46 | — |
| hf-026 | — | — | — | 18 | candidate output below tolerance |
| hf-027 | — | — | — | 41 | candidate output below tolerance |
| hf-028 | -9.87% | 0.795s | 0.874s | 40 | — |
| hf-030 | — | — | — | 32 | candidate output below tolerance |
| hf-029 | — | — | — | 22 | candidate output below tolerance |
| hf-031 | +50.48% | 0.987s | 0.489s | 75 | — |
| 43 |
| 89.74ms |
| — |
| hf-003 | 148.56ms | 0.368s | 32 | 110.29ms | — |
| hf-004 | 172.30ms | 0.572s | 41 | 121.25ms | — |
| hf-005 | 224.12ms | 0.575s | 27 | 95.88ms | — |
| hf-006 | 137.23ms | 0.405s | 31 | 95.01ms | — |
| hf-007 | 149.06ms | 0.410s | 41 | 121.08ms | — |
| hf-008 | 186.31ms | 0.468s | 47 | 90.10ms | — |
| hf-009 | 160.52ms | 0.381s | 43 | 89.13ms | — |
| hf-010 | 165.16ms | 0.385s | 24 | 87.44ms | — |
| hf-011 | 153.29ms | 0.372s | 46 | 100.30ms | — |
| hf-012 | 153.94ms | 0.353s | 43 | 94.76ms | — |
| hf-013 | 153.02ms | 0.372s | 42 | 93.48ms | — |
| hf-014 | 148.24ms | 0.569s | 42 | 130.17ms | — |
| hf-015 | 220.90ms | 0.573s | 47 | 97.98ms | — |
| hf-016 | 169.03ms | 0.416s | 51 | 89.43ms | — |
| hf-017 | 146.74ms | 0.625s | 43 | 137.87ms | — |
| hf-018 | 233.68ms | 0.635s | 48 | 113.73ms | — |
| hf-019 | 175.82ms | 0.435s | 50 | 114.37ms | — |
| hf-020 | 184.78ms | 0.424s | 44 | 98.11ms | — |
| hf-021 | 175.82ms | 0.413s | 45 | 85.61ms | — |
| hf-022 | 149.23ms | 0.407s | 52 | 69.72ms | — |
| hf-023 | 121.13ms | 0.616s | 73 | 142.58ms | — |
| hf-024 | 214.29ms | 0.675s | 47 | 142.66ms | — |
| hf-025 | 213.28ms | 0.606s | 46 | 134.74ms | — |
| hf-026 | 153.00ms | 0.224s | 18 | 25.34ms | — |
| hf-027 | 205.21ms | 0.716s | 41 | 184.98ms | — |
| hf-028 | 195.94ms | 0.874s | 40 | 185.10ms | — |
| hf-029 | 319.33ms | 0.697s | 22 | 131.75ms | — |
| hf-030 | 310.37ms | 0.580s | 32 | 87.37ms | — |
| hf-031 | 246.65ms | 0.489s | 75 | 26.52ms | — |
evidence
requests per s
sla goodput ratio
output tokens per s
p99 e2e ms rel range
p99 itl ms rel range
p99 ttft ms rel range
Image digest
Patch hash