vllm-loop model-improvement progress tracker junk-tokens
models / / #21
▲ MADE POSITIVE PROGRESS

Hourly #9 - c1 leads the published ecosystem

TP8xPP1 c1 ~100-103 tok/s (measured, best-of-N) vs shi3z 8x A100 sm80 52 tok/s and zebgop-ops 4xCMP170HX PP4 16.7 tok/s (both author-reported). Clock-lock is a no-op (CMP clamps); moe_backend=triton fails on MXFP4/SM80; DSpark k=5 pinned by checkpoint. Remaining c1 headroom is kernel-level.

When (PT)2026-09-11 15:14 PT
ServingTP8xPP1, DSpark k=5, fp8_ds_mla, 1M ctx
Enginelocal/vllm-dsv41:sm80 @ dsv41-feat@e47aa780
KV

Benchmarks

MetricValueΔ vs previousUnitContextNote
c1_decode_tok_s (c1_decode_tok_s) 101 tok/s 3.0% tok/s TP8xPP1, best-of-N, shallow context (100-103)

raw JSON: /api/reports/21