models / / #27
▲ MADE POSITIVE PROGRESS
PP6 adopted as the PP default (validated)
PP6 (TP1xPP6, partition 7,7,7,7,7,5, util 0.95) now served: c1 96.9 best-of-4 (107.6 with 93.8% DSpark acceptance) - within noise of TP8xPP1 (100.8), ~2.3x faster than PP8; needle 6/6 + 512k 3/3, coding 5/5; prefill 128k c1 7,716 / c16 23,780; decode 128k c8 164, 512k c8 85.
Benchmarks
| Metric | Value | Δ vs previous | Unit | Context | Note |
|---|---|---|---|---|---|
c1_decode_tok_s (c1_decode_tok_s) |
96.9 tok/s | 0.0% | tok/s | PP6 best-of-4 (107.6 with 93.8% DSpark acceptance) | |
dspark_accept_pct (dspark_accept_pct) |
93.8 % | 1279.4% | % | PP6 on predictable content | |
prefill_tok_s (prefill_tok_s) |
23780 tok/s | -20.9% | tok/s | PP6 c16 @128k |
raw JSON: /api/reports/27