st
Modellserver / Inferenz-Engine
strata
Alle Performance-Benchmarks, die mit diesem Modellserver gemessen wurden – Durchsatz, Prefill und Latenz.
Beste Generation
1.564,6 tok/s
Qwen3.8-Flash-Next
∅ Generation
299,9 tok/s
Schnitt aus 32 Läufen
Bester Prefill
6.384 tok/s
Prompt-Verarbeitung
Bester TTFT
824 ms
Time to First Token
Top-Modelle auf strata
Bester Durchsatz je Modell – umschaltbar nach Generation, Prefill oder Kombiwert.
Auf welcher Hardware laeuft strata am schnellsten?
Bester Durchsatz je Grafikkarte mit diesem Modellserver.
Performanceprofil
Durchsatz mit strata
Jede Blase steht für eine CPU, GPU bzw. ein Modell – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.
CPUnach Prozessor
GPUnach Grafikkarte
Alle Messungen
← Alle Engines32 Benchmark-Läufe
Jeder veroeffentlichte Lauf mit strata.
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.564,61 tok/s TG Prefill 2.600 · TTFT 34.894 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 2 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.132,67 tok/s TG Prefill 1.930 · TTFT 47.978 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 783,55 tok/s TG Prefill 2.459 · TTFT 15.907 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 4 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 638,58 tok/s TG Prefill 306 · TTFT 145.278 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 5 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,23 tok/s TG Prefill 1.826 · TTFT 21.491 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 6 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 492,83 tok/s TG Prefill 1.231 · TTFT 103.873 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 7 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 420,20 tok/s TG Prefill 656 · TTFT 131.641 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 8 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 345,95 tok/s TG Prefill 6.384 · TTFT 6.682 ms | 10× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 9 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,40 tok/s TG Prefill 254 · TTFT 73.516 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 10 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 295,95 tok/s TG Prefill 5.287 · TTFT 2.559 ms | 5× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 11 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,45 tok/s TG Prefill 1.171 · TTFT 47.068 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 12 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,60 tok/s TG Prefill 6.106 · TTFT 8.357 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 13 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,19 tok/s TG Prefill 592 · TTFT 60.940 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 14 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,63 tok/s TG Prefill 5.887 · TTFT 2.145 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 15 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 196,16 tok/s TG Prefill 860 · TTFT 118.321 ms | 10× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 16 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 195,16 tok/s TG Prefill 4.168 · TTFT 11.306 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 191,35 tok/s TG Prefill 2.201 · TTFT 905 ms | 1× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 18 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 184,18 tok/s TG Prefill 3.927 · TTFT 11.977 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 19 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,01 tok/s TG Prefill 3.471 · TTFT 3.864 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 20 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,49 tok/s TG Prefill 3.209 · TTFT 4.175 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 21 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,06 tok/s TG Prefill 1.772 · TTFT 1.128 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 22 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 137,92 tok/s TG Prefill 818 · TTFT 45.184 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 23 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,39 tok/s TG Prefill 1.389 · TTFT 1.421 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 24 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,46 tok/s TG Prefill 1.445 · TTFT 1.367 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 25 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,73 tok/s TG Prefill 2.339 · TTFT 824 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 26 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,80 tok/s TG Prefill 1.364 · TTFT 1.448 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 27 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,02 tok/s TG Prefill 1.132 · TTFT 12.062 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 28 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,11 tok/s TG Prefill 510 · TTFT 3.869 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 29 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,53 tok/s TG Prefill 106 · TTFT 20.413 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 30 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,88 tok/s TG Prefill 909 · TTFT 2.194 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 31 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,60 tok/s TG Prefill 468 · TTFT 4.250 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 32 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,83 tok/s TG Prefill 301 · TTFT 8.495 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → |

