Qwen/Qwen3.8-27B-FP8

closed

Model revision: Campaign ID:

Target GPUs

RTXPRO6000

1× GPU per bench

Submissions

42 passing · 6 rejected

Scoring rule

weighted tier completion speedup

RTXPRO6000

p99 latency

2000 / 50 ms

TTFT / ITL ceiling

Objective

Priority metric

gpu hours

Win condition

>=10% GPU-hour reduction at SLA

Scoring rule

weighted tier completion speedup

Tier weights: 8k: 50% · 16k: 50%

Failure penalty: 0.1 × failed eligible fraction

Any scored request failure caps speed credit at zero before the deduction.

Correctness

Mean logprob ≥ -4
Min token logprob ≥ -16
Coverage ≥ 0.5

Model

Precision

bfloat16 · fp8

Context window

262,144 tokens

Provenance

Baseline repo

github.com/sgl-project/sglang.git

Baseline commit

Patch visibility

Public after 48h 00m from finalized evaluation

Manifest hash

Base image

Baseline engine

Workload

Target GPUs

RTXPRO6000

1× GPU per bench

Submissions

42 passing · 6 rejected

Scoring rule

weighted tier completion speedup

RTXPRO6000

p99 latency

2000 / 50 ms

TTFT / ITL ceiling

Objective

Priority metric

gpu hours

Win condition

>=10% GPU-hour reduction at SLA

Scoring rule

weighted tier completion speedup

Tier weights: 8k: 50% · 16k: 50%

Failure penalty: 0.1 × failed eligible fraction

Any scored request failure caps speed credit at zero before the deduction.

Correctness

Mean logprob ≥ -4
Min token logprob ≥ -16
Coverage ≥ 0.5

Model

Precision

bfloat16 · fp8

Context window

262,144 tokens

Provenance

Baseline repo

github.com/sgl-project/sglang.git

Baseline commit

Patch visibility

Public after 48h 00m from finalized evaluation

Manifest hash

Base image

Baseline engine

Workload

Patch scope

Allowed paths

python/sglang/**rust/**

Denied paths

tests/**benchmarks/**.github/**docker/****/Dockerfile***/pyproject.toml**/setup.py**/setup.cfg**/requirements*.txttest/**benchmark/**python/sglang/test/**python/sglang/kernels/aot/tests/**python/sglang/kernels/aot/python/sgl_kernel/test_utils.pypython/sglang/kernels/aot/python/sgl_kernel/testing/**rust/**/tests/**rust/**/benches/**