Stage
Disqualified
11 of 12 stages
Settled in
5h 34m
committed Sep 17, 09:29 UTC
Round score
—
awaiting round
p99 latency
—
ceiling 2000 / 50 ms
Round 2: disqualified · no score
11/12 stages
Intake & gates
6/6Patch hash recorded; awaiting fetch.
{
"hotkey": "5DU8tk2zcgDQJSGHLmNQ4wbDrgfB5gRT5E84PWroosTXjmjH",
"payment_tx": 12,
"commit_block": 9086484,
"payment_block": 9086481,
"patch_fingerprint": "sha256:3c931565b5edd54218a27297df5c24b19e0efb6953289abde419f63fb55bcf42",
"patch_reveal_delayed": true
}A worker claimed the submission and started the pipeline.
{
"job_id": 143
}Patch artifact retrieved from object storage.
{
"size": 77586,
"patch_hash": "sha256:76cd5987138d54b5e0d324b21845ec87b6864a3c9758f3e287d85b1ea892eaa3"
}Integrity and path constraints checked.
{
"identity": "ok",
"patch_hash": "sha256:76cd5987138d54b5e0d324b21845ec87b6864a3c9758f3e287d85b1ea892eaa3"
}Patch applied onto the baseline checkout.
{
"ok": true
}Public API / surface compatibility held.
{
"files": [
"python/sglang/srt/arg_groups/attention_hook.py",
"python/sglang/srt/arg_groups/speculative_hook.py",
"python/sglang/srt/entrypoints/openai/serving_completions.py",
"python/sglang/srt/layers/attention/linear/gdn_backend.py",
"python/sglang/srt/layers/attention/linear/kernels/gdn_flashinfer.py",
"python/sglang/srt/layers/attention/linear/sn10_extend_graph.py",
"python/sglang/srt/mem_cache/memory_pool.py",
"python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py",
"python/sglang/srt/server_args.py",
"python/sglang/srt/sn10_mtp_defaults.py",
"python/sglang/srt/speculative/eagle_worker_v2.py",
"python/sglang/srt/speculative/sn10_fp8_draft_head.py",
"python/sglang/srt/speculative/sn10_frspec_ids.py"
]
}Build
3/3Hermetic engine image build in progress.
No structured detail recorded for this step.
Candidate engine image pushed to the registry.
{
"image_ref": "ghcr.io/pareton-ai/pareton-engine@sha256:20e9a47d45cc89aa909d11773b0abb1f85465a7dd5446e09295b22e0e2c3e00f",
"image_digest": "sha256:20e9a47d45cc89aa909d11773b0abb1f85465a7dd5446e09295b22e0e2c3e00f"
}Candidate engine image built and digest pinned.
{
"mock": false,
"build_log": "/var/log/pareton/builds/fd1584d8-ec1e-4112-997f-d279ef457e2a/build.log",
"image_ref": "ghcr.io/pareton-ai/pareton-engine@sha256:20e9a47d45cc89aa909d11773b0abb1f85465a7dd5446e09295b22e0e2c3e00f",
"image_tag": "ghcr.io/pareton-ai/pareton-engine:76cd5987138d54b5e0d324b21845ec87b6864a3c9758f3e287d85b1ea892eaa3"
}Round
2/3Waiting to be seated in a round.
No structured detail recorded for this step.
Seated in a round; waiting to run or running.
{
"ordinal": 2,
"round_id": "96185147-2e0c-4632-a3d7-23c8c5f00eae"
}Other events
The image ran and produced wrong output.
{
"score": null,
"reason": "engine died before becoming healthy (last error: [Errno 111] Connection refused); container log tail:\nm_tokens)\n File \"/src/python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py\", line 1546, in capture_one_shape\n self.backend.capture_one(\n File \"/src/python/sglang/srt/model_executor/runner_backend/breakable_cuda_graph_backend.py\", line 123, in capture_one\n warmup_out = forward_fn()\n ^^^^^^^^^^^^\n File \"/src/python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py\", line 1530, in run_once\n return self._run_forward(forward_batch, num_tokens)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/utils/_contextlib.py\", line 124, in decorate_context\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/model_executor/runner/prefill_cuda_graph_runner.py\", line 756, in _run_forward\n return self.layer_model.forward(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/utils/_contextlib.py\", line 124, in decorate_context\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/models/qwen3_5.py\", line 1723, in forward\n hidden_states, residual = layer(\n ^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1778, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1789, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/models/qwen3_5.py\", line 1457, in forward\n hidden_states = self.mlp(hidden_states)\n ^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1778, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1789, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/models/qwen2_moe.py\", line 254, in forward\n gate_up, _ = self.gate_up_proj(x)\n ^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1778, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/opt/venv/lib/python3.12/site-packages/torch/nn/modules/module.py\", line 1789, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/layers/linear.py\", line 505, in forward\n output_parallel = self.quant_method.apply(self, input_, bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/src/python/sglang/srt/layers/quantization/unquant.py\", line 433, in apply\n return F.linear(x, layer.weight, bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\ntorch.OutOfMemoryError: CUDA out of memory. Tried to allocate 136.00 MiB. GPU 3 has a total capacity of 31.36 GiB of which 97.06 MiB is free. Including non-PyTorch memory, this process has 31.11 GiB memory in use. Of the allocated memory 28.19 GiB is allocated by PyTorch, with 959.50 MiB allocated in private pools (e.g., CUDA Graphs), and 354.27 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://docs.pytorch.org/docs/stable/notes/cuda.html#optimizing-memory-usage-with-pytorch-cuda-alloc-conf)\n\n[2026-09-17 14:11:47] Received sigquit from a child process. It usually means the child failed.\n[2026-09-17 14:11:47] kill_process_tree called: parent_pid=1, include_parent=True, pid=1\n[2026-09-17 14:11:47] kill_process_tree called: parent_pid=1, include_parent=False, pid=1\n",
"ordinal": 2,
"round_id": "96185147-2e0c-4632-a3d7-23c8c5f00eae"
}