StepFun
Step-3.5-Flash199.4B
Benchmark profile and published results.
MoE199.4B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation16,8 tok/s
Min 0,0Ø 245,7Max 3.484,3
Unter dem Durchschnitt · 4971 Systeme im Feld
Prefill219 tok/s
Min 4Ø 4.892Max 112.346
Unter dem Durchschnitt · 4953 Systeme im Feld
Time to First Token26.457 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Step-3.5-Flash199.4BStepFun Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,78 tok/s TG Prefill 165 · TTFT 73.137 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Step-3.5-Flash199.4BStepFun Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,35 tok/s TG Prefill 219 · TTFT 122.535 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Step-3.5-Flash199.4BStepFun Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,46 tok/s TG Prefill 99 · TTFT 26.457 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.

