Round score
0.3699
+36.99%
Prompts scored
23 / 32
median_e2e_speedup
Below tolerance
9
answered too little to score
Zeroed total
9
scored 0.0 without measuring
Request interval
Thinking
The same inputs and output limits apply to every engine. Actual concurrency depends on response duration and engine scheduling.
The round score is the scoring rule applied to the prompts below. Both engines are compared at the same output token count, so a candidate that stops early cannot buy speed by answering less: a prompt under the tolerance bar scores nothing and shows its gate reason.
32 prompts
| Prompt | Speedup | Baseline | Candidate | Aligned output | Gate |
|---|---|---|---|---|---|
| hf-001 | +42.45% | 0.396s | 0.228s | 18 | — |
| hf-000 | +50.37% | 0.740s | 0.367s | 40 | — |
| hf-002 | +25.58% | 0.528s | 0.393s |
32 requests
| Request | TTFT | Total | Tokens | Slowest gap | Stream |
|---|---|---|---|---|---|
| hf-000 | 151.10ms | 0.368s | 47 | 89.13ms | — |
| hf-001 | 141.92ms | 0.228s | 18 | 26.28ms | — |
| hf-002 | 174.79ms | 0.457s |
verdict
evidence
min logprob
num prompts
mean logprob
coverage ratio
quantile logprob
num positions scored
role
| 28 |
| — |
| hf-003 | — | — | — | 32 | candidate output below tolerance |
| hf-004 | +25.30% | 0.765s | 0.572s | 41 | — |
| hf-005 | — | — | — | 27 | candidate output below tolerance |
| hf-006 | — | — | — | 31 | candidate output below tolerance |
| hf-007 | +47.24% | 0.778s | 0.410s | 41 | — |
| hf-008 | +45.86% | 0.865s | 0.468s | 42 | — |
| hf-009 | +53.76% | 0.775s | 0.358s | 41 | — |
| hf-010 | — | — | — | 24 | candidate output below tolerance |
| hf-011 | +51.60% | 0.768s | 0.372s | 46 | — |
| hf-012 | +54.34% | 0.565s | 0.258s | 34 | — |
| hf-013 | +49.62% | 0.739s | 0.372s | 40 | — |
| hf-014 | +21.29% | 0.723s | 0.569s | 42 | — |
| hf-015 | +30.20% | 0.821s | 0.573s | 47 | — |
| hf-017 | -18.30% | 0.486s | 0.575s | 28 | — |
| hf-016 | +54.26% | 0.910s | 0.416s | 51 | — |
| hf-018 | — | — | — | 48 | candidate output below tolerance |
| hf-019 | +56.60% | 1.002s | 0.435s | 50 | — |
| hf-020 | +54.97% | 0.941s | 0.424s | 40 | — |
| hf-022 | +43.62% | 0.612s | 0.345s | 24 | — |
| hf-023 | +65.91% | 1.017s | 0.347s | 46 | — |
| hf-021 | +59.49% | 1.020s | 0.413s | 45 | — |
| hf-024 | +33.66% | 1.017s | 0.675s | 47 | — |
| hf-025 | +40.31% | 1.015s | 0.606s | 46 | — |
| hf-026 | — | — | — | 18 | candidate output below tolerance |
| hf-027 | — | — | — | 41 | candidate output below tolerance |
| hf-028 | -9.87% | 0.795s | 0.874s | 40 | — |
| hf-030 | — | — | — | 32 | candidate output below tolerance |
| hf-029 | — | — | — | 22 | candidate output below tolerance |
| hf-031 | +50.48% | 0.987s | 0.489s | 75 | — |
| 43 |
| 89.74ms |
| — |
| hf-003 | 148.56ms | 0.368s | 32 | 110.29ms | — |
| hf-004 | 172.30ms | 0.572s | 41 | 121.25ms | — |
| hf-005 | 224.12ms | 0.575s | 27 | 95.88ms | — |
| hf-006 | 137.23ms | 0.405s | 31 | 95.01ms | — |
| hf-007 | 149.06ms | 0.410s | 41 | 121.08ms | — |
| hf-008 | 186.31ms | 0.468s | 47 | 90.10ms | — |
| hf-009 | 160.52ms | 0.381s | 43 | 89.13ms | — |
| hf-010 | 165.16ms | 0.385s | 24 | 87.44ms | — |
| hf-011 | 153.29ms | 0.372s | 46 | 100.30ms | — |
| hf-012 | 153.94ms | 0.353s | 43 | 94.76ms | — |
| hf-013 | 153.02ms | 0.372s | 42 | 93.48ms | — |
| hf-014 | 148.24ms | 0.569s | 42 | 130.17ms | — |
| hf-015 | 220.90ms | 0.573s | 47 | 97.98ms | — |
| hf-016 | 169.03ms | 0.416s | 51 | 89.43ms | — |
| hf-017 | 146.74ms | 0.625s | 43 | 137.87ms | — |
| hf-018 | 233.68ms | 0.635s | 48 | 113.73ms | — |
| hf-019 | 175.82ms | 0.435s | 50 | 114.37ms | — |
| hf-020 | 184.78ms | 0.424s | 44 | 98.11ms | — |
| hf-021 | 175.82ms | 0.413s | 45 | 85.61ms | — |
| hf-022 | 149.23ms | 0.407s | 52 | 69.72ms | — |
| hf-023 | 121.13ms | 0.616s | 73 | 142.58ms | — |
| hf-024 | 214.29ms | 0.675s | 47 | 142.66ms | — |
| hf-025 | 213.28ms | 0.606s | 46 | 134.74ms | — |
| hf-026 | 153.00ms | 0.224s | 18 | 25.34ms | — |
| hf-027 | 205.21ms | 0.716s | 41 | 184.98ms | — |
| hf-028 | 195.94ms | 0.874s | 40 | 185.10ms | — |
| hf-029 | 319.33ms | 0.697s | 22 | 131.75ms | — |
| hf-030 | 310.37ms | 0.580s | 32 | 87.37ms | — |
| hf-031 | 246.65ms | 0.489s | 75 | 26.52ms | — |
evidence
requests per s
sla goodput ratio
output tokens per s
p99 e2e ms rel range
p99 itl ms rel range
p99 ttft ms rel range
Image digest
Patch hash