Created bymario-alka.dePowered bynoob2claw.detricoma.de
Qwen (Alibaba)

Qwen3.8-Flash-Next180B

Benchmarkprofil und veröffentlichte Ergebnisse.

MoE180B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation1.564,6 tok/s
Min 7,0Ø 548,7Max 2.143,6
Ueber dem Durchschnitt · 557 Systeme im Feld
Prefill17.642 tok/s
Min 28Ø 6.465Max 43.711
Ueber dem Durchschnitt · 542 Systeme im Feld
Time to First Token243 ms
Min 59Ø 8.885Max 168.314
Ueber dem Durchschnitt · 557 Systeme im Feld
Harness-Quote100,0 %
Min 37,1Ø 73,3Max 100,0
Spitzenwert im Feld · 32 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

2.0301.5231.0155080,005.46510.93016.395Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.564,6 tok/s Generation, 6.065 tok/s Prefill, TTFT 7.635 ms (15 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 1.171,8 tok/s Generation, 963 tok/s Prefill, TTFT 32.556 ms (21 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 - 1.132,7 tok/s Generation, 1.949 tok/s Prefill, TTFT 28.686 ms (12 Laufe)NVIDIA GeForce RTX 30...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 584,1 tok/s Generation, 13.248 tok/s Prefill, TTFT 766 ms (8 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA DGX SPARK (GB10) - 492,8 tok/s Generation, 1.262 tok/s Prefill, TTFT 33.373 ms (12 Laufe)NVIDIA DGX SPARK (GB1...NVIDIA GeForce RTX 5090 - 346,0 tok/s Generation, 4.624 tok/s Prefill, TTFT 3.382 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA Tesla V100 PCIe 32GB - 196,2 tok/s Generation, 775 tok/s Prefill, TTFT 30.834 ms (8 Laufe)NVIDIA Tesla V100 PCI...AMD Radeon RX 7900 XTX - 18,7 tok/s Generation, 180 tok/s Prefill, TTFT 55.956 ms (3 Laufe)AMD Radeon RX 7900 XTX
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.564,6 tok/sNVIDIA RTX A6000 1.171,8 tok/sNVIDIA GeForce RTX 3090 1.132,7 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 584,1 tok/sNVIDIA DGX SPARK (GB10) 492,8 tok/sNVIDIA GeForce RTX 5090 346,0 tok/sNVIDIA Tesla V100 PCIe 32GB 196,2 tok/sAMD Radeon RX 7900 XTX 18,7 tok/s

CPUnach Prozessor

2.0301.5231.0155080,005.47610.95216.428Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 7945HX with Radeon Graphics - 1.564,6 tok/s Generation, 2.312 tok/s Prefill, TTFT 17.248 ms (6 Laufe)AMD Ryzen 9 7945HX wi...AMD Ryzen Threadripper PRO 3945WX 12-Cores - 1.171,8 tok/s Generation, 2.569 tok/s Prefill, TTFT 15.123 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 5 5600X 6-Core Processor - 1.132,7 tok/s Generation, 4.274 tok/s Prefill, TTFT 23.110 ms (15 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen 9 9950X 16-Core Processor - 584,1 tok/s Generation, 13.248 tok/s Prefill, TTFT 766 ms (8 Laufe)AMD Ryzen 9 9950X 16-...NVIDIA Grace - 492,8 tok/s Generation, 1.262 tok/s Prefill, TTFT 33.373 ms (12 Laufe)NVIDIA GraceAMD Ryzen Threadripper PRO 9965WX 24-Cores - 424,2 tok/s Generation, 0 tok/s Prefill, TTFT 1.438 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 7 5800X3D 8-Core Processor - 346,0 tok/s Generation, 4.624 tok/s Prefill, TTFT 3.382 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics - 196,2 tok/s Generation, 757 tok/s Prefill, TTFT 36.737 ms (5 Laufe)AMD Ryzen 3 PRO 3200G...AMD EPYC 7203P 8-Core Processor - 79,2 tok/s Generation, 320 tok/s Prefill, TTFT 39.530 ms (15 Laufe)AMD EPYC 7203P 8-Core...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 63,2 tok/s Generation, 803 tok/s Prefill, TTFT 20.996 ms (3 Laufe)Intel(R) Xeon(R) CPU ...AMD Ryzen Threadripper PRO 3955WX 16-Cores - 18,7 tok/s Generation, 180 tok/s Prefill, TTFT 55.956 ms (3 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen 9 7945HX with Radeon Graphics 1.564,6 tok/sAMD Ryzen Threadripper PRO 3945WX 12-Cores 1.171,8 tok/sAMD Ryzen 5 5600X 6-Core Processor 1.132,7 tok/sAMD Ryzen 9 9950X 16-Core Processor 584,1 tok/sNVIDIA Grace 492,8 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 424,2 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 346,0 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 196,2 tok/sAMD EPYC 7203P 8-Core Processor 79,2 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 63,2 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 18,7 tok/s

ENGnach Engine

1.9651.4749834910,005.02910.05815.087Prefill (tok/s)Generation (tok/s)strata - 1.564,6 tok/s Generation, 1.819 tok/s Prefill, TTFT 32.559 ms (29 Laufe)stratallama.cpp - 1.555,3 tok/s Generation, 627 tok/s Prefill, TTFT 35.323 ms (24 Laufe)llama.cppunbekannt - 1.171,8 tok/s Generation, 1.981 tok/s Prefill, TTFT 17.080 ms (9 Laufe)unbekanntvLLM - 584,1 tok/s Generation, 10.429 tok/s Prefill, TTFT 1.500 ms (17 Laufe)vLLMtensorfold - 344,4 tok/s Generation, 12.258 tok/s Prefill, TTFT 1.105 ms (3 Laufe)tensorfold
strata 1.564,6 tok/sllama.cpp 1.555,3 tok/sunbekannt 1.171,8 tok/svLLM 584,1 tok/stensorfold 344,4 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.564,61 tok/s TG
Prefill 2.600 · TTFT 34.894 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
2Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.555,31 tok/s TG
Prefill 2.655 · TTFT 34.751 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
3Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.171,75 tok/s TG
Prefill 2.132 · TTFT 45.396 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
4Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.132,67 tok/s TG
Prefill 1.930 · TTFT 47.978 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
5Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
804,23 tok/s TG
Prefill 2.435 · TTFT 15.796 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
6Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
783,55 tok/s TG
Prefill 2.459 · TTFT 15.907 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
7Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
638,58 tok/s TG
Prefill 306 · TTFT 145.278 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
8Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
589,46 tok/s TG
Prefill 2.120 · TTFT 21.049 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
9Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
584,06 tok/s TG
Prefill 25.276 · TTFT 1.075 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
10Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
572,23 tok/s TG
Prefill 1.826 · TTFT 21.491 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
11Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
492,83 tok/s TG
Prefill 1.231 · TTFT 103.873 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
12Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
424,23 tok/s TG
Prefill - · TTFT 1.608 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
13Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
420,20 tok/s TG
Prefill 656 · TTFT 131.641 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
14Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
418,77 tok/s TG
Prefill 17.642 · TTFT 1.399 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
15Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,27 tok/s TG
Prefill - · TTFT 2.092 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
16Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,28 tok/s TG
Prefill 20.534 · TTFT 617 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
17Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
345,95 tok/s TG
Prefill 6.384 · TTFT 6.682 ms
10×NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAMstratagodclawIQ2_XS
18Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
344,40 tok/s TG
Prefill 16.771 · TTFT 2.037 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
19Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
319,40 tok/s TG
Prefill 254 · TTFT 73.516 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
20Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
302,61 tok/s TG
Prefill - · TTFT 612 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
21Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
295,95 tok/s TG
Prefill 5.287 · TTFT 2.559 ms
5×NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAMstratagodclawIQ2_XS
22Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,09 tok/s TG
Prefill 15.257 · TTFT 775 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
23Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
257,18 tok/s TG
Prefill - · TTFT 3.386 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
24Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
246,45 tok/s TG
Prefill 1.171 · TTFT 47.068 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
25Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,85 tok/s TG
Prefill 14.238 · TTFT 934 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
26Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,41 tok/s TG
Prefill 4.265 · TTFT 17.947 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
27Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,19 tok/s TG
Prefill 592 · TTFT 60.940 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
28Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
196,16 tok/s TG
Prefill 860 · TTFT 118.321 ms
10×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
29Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
195,16 tok/s TG
Prefill 4.168 · TTFT 11.306 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
30Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
191,35 tok/s TG
Prefill 2.201 · TTFT 905 ms
1×NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAMstratagodclawIQ2_XS
31Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,18 tok/s TG
Prefill 3.927 · TTFT 11.977 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
32Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
165,01 tok/s TG
Prefill 3.471 · TTFT 3.864 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
33Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,58 tok/s TG
Prefill 1.951 · TTFT 1.010 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
34Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,49 tok/s TG
Prefill 3.209 · TTFT 4.175 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
35Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,06 tok/s TG
Prefill 1.772 · TTFT 1.128 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
36Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
139,55 tok/s TG
Prefill 3.687 · TTFT 3.821 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
37Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
137,92 tok/s TG
Prefill 818 · TTFT 45.184 ms
5×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
38Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,24 tok/s TG
Prefill 1.458 · TTFT 1.399 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
39Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,39 tok/s TG
Prefill 3.269 · TTFT 6.004 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
40Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,39 tok/s TG
Prefill 1.389 · TTFT 1.421 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
41Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,48 tok/s TG
Prefill 1.754 · TTFT 1.124 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
42Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
108,46 tok/s TG
Prefill 1.445 · TTFT 1.367 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
43Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,80 tok/s TG
Prefill 1.364 · TTFT 1.448 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
44Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,74 tok/s TG
Prefill 9.683 · TTFT 204 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
45Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,00 tok/s TG
Prefill 470 · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
46Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
88,87 tok/s TG
Prefill 1.120 · TTFT 20.453 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
47Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,45 tok/s TG
Prefill 2.547 · TTFT 3.826 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
48Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,19 tok/s TG
Prefill 670 · TTFT 33.965 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
49Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,14 tok/s TG
Prefill 7.814 · TTFT 243 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
50Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
77,21 tok/s TG
Prefill - · TTFT 344 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
51Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,79 tok/s TG
Prefill 5.764 · TTFT 344 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
52Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,23 tok/s TG
Prefill - · TTFT 590 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
53Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,30 tok/s TG
Prefill 487 · TTFT 20.813 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
54Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,73 tok/s TG
Prefill 560 · TTFT 40.628 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
55Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,00 tok/s TG
Prefill - · TTFT 0 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
56Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,46 tok/s TG
Prefill 568 · TTFT 39.939 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
57Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
66,02 tok/s TG
Prefill 838 · TTFT 12.155 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
58Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,23 tok/s TG
Prefill 904 · TTFT 15.542 ms
5×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
59Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,09 tok/s TG
Prefill 1.023 · TTFT 43.363 ms
10×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
60Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,89 tok/s TG
Prefill 409 · TTFT 24.788 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
61Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
59,28 tok/s TG
Prefill 483 · TTFT 4.084 ms
1×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
62Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
59,02 tok/s TG
Prefill 1.132 · TTFT 12.062 ms
5×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
63Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
55,85 tok/s TG
Prefill 415 · TTFT 24.406 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
64Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,11 tok/s TG
Prefill 510 · TTFT 3.869 ms
1×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
65Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,53 tok/s TG
Prefill 106 · TTFT 20.413 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
66Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,88 tok/s TG
Prefill 909 · TTFT 2.194 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
67Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,60 tok/s TG
Prefill 468 · TTFT 4.250 ms
1×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
68Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,83 tok/s TG
Prefill 301 · TTFT 8.495 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
69Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
38,84 tok/s TG
Prefill 258 · TTFT 10.963 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
70Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,99 tok/s TG
Prefill 221 · TTFT 12.961 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
71Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,38 tok/s TG
Prefill 714 · TTFT 2.760 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
72Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,58 tok/s TG
Prefill 220 · TTFT 12.963 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
73Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,44 tok/s TG
Prefill 249 · TTFT 90.371 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
74Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,77 tok/s TG
Prefill 160 · TTFT 63.351 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
75Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,97 tok/s TG
Prefill 204 · TTFT 110.341 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
76Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,26 tok/s TG
Prefill 1.798 · TTFT 1.074 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
77Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,67 tok/s TG
Prefill 124 · TTFT 18.211 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
78Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,36 tok/s TG
Prefill 158 · TTFT 64.302 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
79Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,69 tok/s TG
Prefill 245 · TTFT 92.959 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
80Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,75 tok/s TG
Prefill 182 · TTFT 55.630 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
81Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,85 tok/s TG
Prefill 114 · TTFT 19.280 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
82Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,95 tok/s TG
Prefill 94 · TTFT 24.951 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
Agent- & Chat-Bewertung

Harnessbenchmark

Messwert:
#Modell / HerstellerMesswerteGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkOffice Agentic Work 100 - Tool Usage V1
100 Pkt
100,0% · 100/100 Aufg. · 751,6 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMofficeagentic100NVFP4
2Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
206 Pkt
98,1% · 206/210 Aufg. · 1.001,2 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
3Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
297 Pkt
95,8% · 297/310 Aufg. · 2.578,6 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4
4Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
145 Pkt
69,0% · 145/210 Aufg. · 145,4 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
5Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
107 Pkt
53,5% · 107/200 Aufg. · 38,9 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
6Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
164 Pkt
52,9% · 164/310 Aufg. · 208,4 s
2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4