Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,38 tok/s TG
Prefill 14.373 · TTFT 1.721 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
2Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
417,52 tok/s TG
Prefill 12.747 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
3Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 8.225 · TTFT 296 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
4Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
418,77 tok/s TG
Prefill 17.642 · TTFT 1.399 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
5Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,09 tok/s TG
Prefill 15.257 · TTFT 775 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
6Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,14 tok/s TG
Prefill 7.814 · TTFT 243 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
7NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.562,27 tok/s TG
Prefill 2.593 · TTFT 34.854 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
8NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
795,03 tok/s TG
Prefill 2.378 · TTFT 15.951 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
9NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,32 tok/s TG
Prefill 1.225 · TTFT 2.121 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
10Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.555,31 tok/s TG
Prefill 2.655 · TTFT 34.751 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
11Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
804,23 tok/s TG
Prefill 2.435 · TTFT 15.796 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
12Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,58 tok/s TG
Prefill 1.951 · TTFT 1.010 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
13Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.564,61 tok/s TG
Prefill 2.600 · TTFT 34.894 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
14Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
783,55 tok/s TG
Prefill 2.459 · TTFT 15.907 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
15Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,06 tok/s TG
Prefill 1.772 · TTFT 1.128 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
16Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
1.044,38 tok/s TG
Prefill 38.866 · TTFT 388 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
17Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
589,64 tok/s TG
Prefill 43.711 · TTFT 223 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
18Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
133,13 tok/s TG
Prefill 20.590 · TTFT 106 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
19Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkOffice Agentic Work 100 - Tool Usage V1
100 Pkt
100,0% · 100/100 Aufg. · 751,6 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMofficeagentic100NVFP4
20Kolibri-178.1BAleph Alpha HarnessbenchmarkOffice Agentic Work 100 - Tool Usage V1
100 Pkt
100,0% · 100/100 Aufg. · 547,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMofficeagentic100NVFP4
21Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
833,03 tok/s TG
Prefill - · TTFT 213 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
22Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
490,51 tok/s TG
Prefill - · TTFT 177 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
23Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,86 tok/s TG
Prefill - · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
24Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
283 Pkt
91,3% · 283/310 Aufg. · 2.384,4 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
25Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
119 Pkt
38,4% · 119/310 Aufg. · 87,9 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
26Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,92 tok/s TG
Prefill - · TTFT 227 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
27Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
297 Pkt
95,8% · 297/310 Aufg. · 2.578,6 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4
28Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,30 tok/s TG
Prefill - · TTFT 165 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
29Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,47 tok/s TG
Prefill - · TTFT 98 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
30Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
289 Pkt
93,2% · 289/310 Aufg. · 2.504,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
31Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
164 Pkt
52,9% · 164/310 Aufg. · 208,4 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4
32Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
115 Pkt
37,1% · 115/310 Aufg. · 99,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
33Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
424,23 tok/s TG
Prefill - · TTFT 1.608 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
34Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
302,61 tok/s TG
Prefill - · TTFT 612 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
35Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
77,21 tok/s TG
Prefill - · TTFT 344 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
36Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
846,62 tok/s TG
Prefill - · TTFT 238 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
37Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
569,97 tok/s TG
Prefill - · TTFT 160 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
38Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,71 tok/s TG
Prefill - · TTFT 160 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
39Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
207 Pkt
98,6% · 207/210 Aufg. · 1.080,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
40Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
108 Pkt
51,4% · 108/210 Aufg. · 72,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
41Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,27 tok/s TG
Prefill - · TTFT 2.092 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
42Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
257,18 tok/s TG
Prefill - · TTFT 3.386 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
43Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,23 tok/s TG
Prefill - · TTFT 590 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
44Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
206 Pkt
98,1% · 206/210 Aufg. · 1.001,2 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
45Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
145 Pkt
69,0% · 145/210 Aufg. · 145,4 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
46Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 57,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMBuzzwordTrainAWQ
47Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
107 Pkt
53,5% · 107/200 Aufg. · 38,9 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
48Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
110 Pkt
55,0% · 110/200 Aufg. · 28,7 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
49Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
101 Pkt
50,5% · 101/200 Aufg. · 36,8 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
50Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
193 Pkt
96,5% · 193/200 Aufg. · 3.667,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
51Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
87 Pkt
43,5% · 87/200 Aufg. · 19,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
52Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 36,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
53Nemotron-Cascade-2-30B-A3B30BNVIDIA HarnessbenchmarkDecision-Benchmark V 1.0
159 Pkt
79,5% · 159/200 Aufg. · 35,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
54Laya0.4BConvai Innovations HarnessbenchmarkDecision-Benchmark V 1.0
122 Pkt
61,0% · 122/200 Aufg. · 14,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorch
55Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 29,9 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
56Open-Jev-27B-v1.127BZefan Cai / Open-Jev HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 75,5 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorchBF16
57Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,60 tok/s TG
Prefill 1.882 · TTFT 2.287 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
58Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,90 tok/s TG
Prefill 3.268 · TTFT 1.317 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
59Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,30 tok/s TG
Prefill 11.550 · TTFT 373 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
60GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,75 tok/s TG
Prefill 987 · TTFT 26.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
61GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,94 tok/s TG
Prefill 762 · TTFT 15.666 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
62GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,01 tok/s TG
Prefill 441 · TTFT 4.837 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
63Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.100,69 tok/s TG
Prefill 27.110 · TTFT 739 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
64Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
608,35 tok/s TG
Prefill 23.343 · TTFT 414 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
65Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,73 tok/s TG
Prefill 15.397 · TTFT 126 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
66gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,40 tok/s TG
Prefill 15.615 · TTFT 1.677 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
67gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,78 tok/s TG
Prefill 12.359 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
68gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,12 tok/s TG
Prefill 7.867 · TTFT 251 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
69Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,90 tok/s TG
Prefill 3.820 · TTFT 15.880 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
70Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
429,63 tok/s TG
Prefill 3.334 · TTFT 6.284 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
71Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
135,13 tok/s TG
Prefill 2.928 · TTFT 938 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
72Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,10 tok/s TG
Prefill 3.866 · TTFT 16.399 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
73Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
437,16 tok/s TG
Prefill 3.329 · TTFT 6.298 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
74Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
135,22 tok/s TG
Prefill 2.941 · TTFT 933 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
75Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,82 tok/s TG
Prefill 2.814 · TTFT 19.437 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
76Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
413,18 tok/s TG
Prefill 2.358 · TTFT 8.016 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
77Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,97 tok/s TG
Prefill 2.205 · TTFT 1.246 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
78Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
762,72 tok/s TG
Prefill 4.616 · TTFT 15.283 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
79Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
440,78 tok/s TG
Prefill 3.886 · TTFT 5.752 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
80Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
777,69 tok/s TG
Prefill 3.903 · TTFT 16.458 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
81Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
434,94 tok/s TG
Prefill 3.365 · TTFT 6.267 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
82Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
706,85 tok/s TG
Prefill 2.752 · TTFT 19.766 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
83Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
405,17 tok/s TG
Prefill 2.414 · TTFT 7.850 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
84Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,54 tok/s TG
Prefill 2.199 · TTFT 79.387 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
85Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,40 tok/s TG
Prefill 1.968 · TTFT 23.096 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
86Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,55 tok/s TG
Prefill 1.165 · TTFT 1.835 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
87Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,08 tok/s TG
Prefill 1.589 · TTFT 83.232 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
88Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,74 tok/s TG
Prefill 1.649 · TTFT 24.427 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
89Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,50 tok/s TG
Prefill 980 · TTFT 2.182 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
90Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,87 tok/s TG
Prefill 1.165 · TTFT 108.105 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
91Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,80 tok/s TG
Prefill 1.092 · TTFT 32.891 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
92Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,83 tok/s TG
Prefill 699 · TTFT 3.073 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
93MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
548,62 tok/s TG
Prefill 4.931 · TTFT 20.370 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
94MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
312,31 tok/s TG
Prefill 4.491 · TTFT 6.623 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
95MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,58 tok/s TG
Prefill 2.290 · TTFT 1.014 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
96MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
530,51 tok/s TG
Prefill 4.240 · TTFT 21.543 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
97MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
305,98 tok/s TG
Prefill 3.962 · TTFT 7.171 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
98MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,80 tok/s TG
Prefill 1.953 · TTFT 1.180 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
99NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
423,26 tok/s TG
Prefill 2.897 · TTFT 27.048 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
100NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,46 tok/s TG
Prefill 2.760 · TTFT 8.787 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
101NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
87,17 tok/s TG
Prefill 1.587 · TTFT 1.411 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
102NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
423,38 tok/s TG
Prefill 2.668 · TTFT 27.534 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
103NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,33 tok/s TG
Prefill 2.465 · TTFT 9.171 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
104NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
87,06 tok/s TG
Prefill 1.359 · TTFT 1.804 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
105Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
564,60 tok/s TG
Prefill 3.577 · TTFT 19.963 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
106Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
308,32 tok/s TG
Prefill 3.271 · TTFT 6.567 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
107Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,28 tok/s TG
Prefill 2.209 · TTFT 883 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
108Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
557,10 tok/s TG
Prefill 3.042 · TTFT 20.906 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
109Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
307,65 tok/s TG
Prefill 2.768 · TTFT 7.045 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
110Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
103,61 tok/s TG
Prefill 2.040 · TTFT 951 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
111NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
423,31 tok/s TG
Prefill 2.911 · TTFT 27.041 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
112NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,07 tok/s TG
Prefill 2.719 · TTFT 8.878 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
113NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,68 tok/s TG
Prefill 1.767 · TTFT 1.224 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
114NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
422,61 tok/s TG
Prefill 2.701 · TTFT 27.527 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
115NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
237,98 tok/s TG
Prefill 2.469 · TTFT 9.177 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
116NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,77 tok/s TG
Prefill 1.759 · TTFT 1.226 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
117Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
549,60 tok/s TG
Prefill 3.637 · TTFT 19.950 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
118Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
308,96 tok/s TG
Prefill 3.279 · TTFT 6.536 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
119Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,54 tok/s TG
Prefill 2.245 · TTFT 862 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
120Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
561,09 tok/s TG
Prefill 2.997 · TTFT 20.809 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
121Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
307,99 tok/s TG
Prefill 2.795 · TTFT 7.017 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
122Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
103,91 tok/s TG
Prefill 2.025 · TTFT 954 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
123Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
203,47 tok/s TG
Prefill 963 · TTFT 58.166 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
124Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,40 tok/s TG
Prefill 1.007 · TTFT 19.503 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
125Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,23 tok/s TG
Prefill 756 · TTFT 2.908 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
126Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.398,38 tok/s TG
Prefill 8.247 · TTFT 8.094 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
127Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
762,10 tok/s TG
Prefill 7.476 · TTFT 2.681 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
128Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,43 tok/s TG
Prefill 4.807 · TTFT 401 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
129Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,72 tok/s TG
Prefill 2.246 · TTFT 36.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
130Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,49 tok/s TG
Prefill 2.071 · TTFT 12.702 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
131Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,38 tok/s TG
Prefill 1.555 · TTFT 1.746 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
132Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,41 tok/s TG
Prefill 2.100 · TTFT 37.421 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
133Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,66 tok/s TG
Prefill 2.017 · TTFT 12.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
134Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,48 tok/s TG
Prefill 1.516 · TTFT 1.792 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
135DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
382,08 tok/s TG
Prefill 2.421 · TTFT 30.058 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
136DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,88 tok/s TG
Prefill 2.064 · TTFT 10.570 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
137DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,03 tok/s TG
Prefill 1.664 · TTFT 1.377 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
138DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
385,91 tok/s TG
Prefill 2.350 · TTFT 30.012 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
139DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
206,50 tok/s TG
Prefill 2.080 · TTFT 10.489 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
140DeepSeek-V4-Flash-284B-A13B284BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,33 tok/s TG
Prefill 1.735 · TTFT 1.320 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
141Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,08 tok/s TG
Prefill 1.013 · TTFT 161.953 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
142Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,07 tok/s TG
Prefill 958 · TTFT 47.870 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
143Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,40 tok/s TG
Prefill 644 · TTFT 3.793 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
144Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,28 tok/s TG
Prefill 761 · TTFT 168.314 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
145Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,63 tok/s TG
Prefill 812 · TTFT 50.633 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
146Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,40 tok/s TG
Prefill 547 · TTFT 4.475 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
147Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
203,75 tok/s TG
Prefill 3.332 · TTFT 47.827 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
148Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,05 tok/s TG
Prefill 3.476 · TTFT 13.786 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
149Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,55 tok/s TG
Prefill 2.137 · TTFT 1.149 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
150Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
202,24 tok/s TG
Prefill 2.746 · TTFT 49.827 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
151Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,63 tok/s TG
Prefill 2.633 · TTFT 14.998 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
152Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,44 tok/s TG
Prefill 1.610 · TTFT 1.524 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
153Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,46 tok/s TG
Prefill 1.711 · TTFT 62.671 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
154Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,86 tok/s TG
Prefill 1.631 · TTFT 19.862 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
155Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,49 tok/s TG
Prefill 1.149 · TTFT 2.146 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
156Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
291,20 tok/s TG
Prefill 2.971 · TTFT 34.561 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
157Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,68 tok/s TG
Prefill 2.983 · TTFT 10.578 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
158Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
38,26 tok/s TG
Prefill 2.396 · TTFT 1.025 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
159Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
302,99 tok/s TG
Prefill 2.480 · TTFT 36.311 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
160Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,21 tok/s TG
Prefill 2.237 · TTFT 11.826 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
161Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
44,78 tok/s TG
Prefill 2.079 · TTFT 1.179 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
162Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
249,27 tok/s TG
Prefill 1.839 · TTFT 45.580 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
163Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,58 tok/s TG
Prefill 1.677 · TTFT 15.124 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
164Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
39,31 tok/s TG
Prefill 1.618 · TTFT 1.513 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
165Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,82 tok/s TG
Prefill 750 · TTFT 2.935 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
166Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
200,61 tok/s TG
Prefill 1.005 · TTFT 54.811 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
167Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
113,48 tok/s TG
Prefill 978 · TTFT 18.052 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
168Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
44,51 tok/s TG
Prefill 942 · TTFT 2.274 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
169Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
167,22 tok/s TG
Prefill 896 · TTFT 65.273 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
170Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,03 tok/s TG
Prefill 811 · TTFT 23.516 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
171Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,15 tok/s TG
Prefill 809 · TTFT 2.652 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
172Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
365,25 tok/s TG
Prefill 4.623 · TTFT 26.204 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
173Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
203,80 tok/s TG
Prefill 4.269 · TTFT 7.822 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
174Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
56,80 tok/s TG
Prefill 3.264 · TTFT 676 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
175Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
383,93 tok/s TG
Prefill 3.677 · TTFT 27.389 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
176Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
202,50 tok/s TG
Prefill 3.460 · TTFT 8.377 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
177Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
58,05 tok/s TG
Prefill 3.016 · TTFT 729 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
178Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
321,91 tok/s TG
Prefill 2.363 · TTFT 34.311 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
179Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
170,76 tok/s TG
Prefill 2.154 · TTFT 11.118 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
180Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,53 tok/s TG
Prefill 1.915 · TTFT 1.155 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
181Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.799,41 tok/s TG
Prefill 9.192 · TTFT 8.876 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
182Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
762,69 tok/s TG
Prefill 8.704 · TTFT 2.484 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
183Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
264,61 tok/s TG
Prefill 5.077 · TTFT 385 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
184Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.447,27 tok/s TG
Prefill 8.138 · TTFT 7.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
185Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
780,58 tok/s TG
Prefill 7.221 · TTFT 2.850 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
186Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
240,47 tok/s TG
Prefill 5.000 · TTFT 386 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
187Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.400,99 tok/s TG
Prefill 6.038 · TTFT 8.703 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
188Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
794,89 tok/s TG
Prefill 5.470 · TTFT 3.060 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
189Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
266,28 tok/s TG
Prefill 4.441 · TTFT 434 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
190Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.367,32 tok/s TG
Prefill 9.899 · TTFT 8.047 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
191Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
745,03 tok/s TG
Prefill 8.908 · TTFT 2.564 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
192Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
243,43 tok/s TG
Prefill 5.614 · TTFT 346 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
193Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.341,33 tok/s TG
Prefill 8.440 · TTFT 8.344 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
194Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
654,42 tok/s TG
Prefill 7.610 · TTFT 2.746 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
195Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,74 tok/s TG
Prefill 2.392 · TTFT 977 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
196Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.212,13 tok/s TG
Prefill 6.225 · TTFT 8.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
197Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
716,74 tok/s TG
Prefill 4.374 · TTFT 3.675 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
198Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
223,05 tok/s TG
Prefill 4.431 · TTFT 435 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
199Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.361,67 tok/s TG
Prefill 9.538 · TTFT 7.854 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
200Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
753,03 tok/s TG
Prefill 8.746 · TTFT 2.522 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
201Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
207,52 tok/s TG
Prefill 5.470 · TTFT 354 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
202Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.389,23 tok/s TG
Prefill 7.940 · TTFT 8.056 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
203Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
724,87 tok/s TG
Prefill 7.439 · TTFT 2.684 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
204Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.243,85 tok/s TG
Prefill 5.117 · TTFT 9.159 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
205Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
728,82 tok/s TG
Prefill 6.326 · TTFT 3.026 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
206Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,86 tok/s TG
Prefill 4.467 · TTFT 432 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
207Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.363,39 tok/s TG
Prefill 9.248 · TTFT 8.137 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
208Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
727,21 tok/s TG
Prefill 8.572 · TTFT 2.616 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
209Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,58 tok/s TG
Prefill 4.770 · TTFT 407 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
210Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.338,40 tok/s TG
Prefill 8.627 · TTFT 8.328 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
211Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
739,54 tok/s TG
Prefill 7.791 · TTFT 2.713 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
212Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,27 tok/s TG
Prefill 5.467 · TTFT 353 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
213Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.348,63 tok/s TG
Prefill 6.479 · TTFT 8.949 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
214Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
739,97 tok/s TG
Prefill 5.761 · TTFT 3.093 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
215Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,99 tok/s TG
Prefill 4.689 · TTFT 412 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
216Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
412,83 tok/s TG
Prefill 6.968 · TTFT 24.214 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
217Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
218,33 tok/s TG
Prefill 6.144 · TTFT 7.137 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
218Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,51 tok/s TG
Prefill 3.003 · TTFT 870 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
219Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
404,40 tok/s TG
Prefill 6.093 · TTFT 25.028 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
220Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,39 tok/s TG
Prefill 5.705 · TTFT 7.309 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
221Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,60 tok/s TG
Prefill 2.989 · TTFT 822 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
222Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
342,04 tok/s TG
Prefill 3.606 · TTFT 31.087 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
223Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
179,05 tok/s TG
Prefill 3.577 · TTFT 9.635 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
224Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,14 tok/s TG
Prefill 2.196 · TTFT 1.120 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
225Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
412,58 tok/s TG
Prefill 6.480 · TTFT 24.413 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
226Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,09 tok/s TG
Prefill 6.838 · TTFT 6.933 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
227Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,51 tok/s TG
Prefill 3.434 · TTFT 718 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
228Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
406,23 tok/s TG
Prefill 5.348 · TTFT 25.223 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
229Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
213,98 tok/s TG
Prefill 5.838 · TTFT 7.294 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
230Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,99 tok/s TG
Prefill 3.625 · TTFT 681 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
231Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
343,00 tok/s TG
Prefill 3.698 · TTFT 31.024 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
232Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,11 tok/s TG
Prefill 3.409 · TTFT 8.759 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
233Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
40,21 tok/s TG
Prefill 2.441 · TTFT 1.008 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawAWQ
234Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,40 tok/s TG
Prefill 2.260 · TTFT 36.888 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
235Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,27 tok/s TG
Prefill 2.011 · TTFT 12.859 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
236Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
321,42 tok/s TG
Prefill 2.147 · TTFT 37.376 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
237Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
186,37 tok/s TG
Prefill 1.992 · TTFT 12.967 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
238OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,74 tok/s TG
Prefill 6.821 · TTFT 24.282 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
239OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,61 tok/s TG
Prefill 6.206 · TTFT 7.079 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
240OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,56 tok/s TG
Prefill 3.452 · TTFT 709 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
241OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
391,83 tok/s TG
Prefill 5.175 · TTFT 25.101 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
242OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,53 tok/s TG
Prefill 5.226 · TTFT 7.446 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
243OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,59 tok/s TG
Prefill 2.641 · TTFT 930 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
244OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
342,61 tok/s TG
Prefill 3.592 · TTFT 31.111 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
245OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
182,02 tok/s TG
Prefill 3.427 · TTFT 9.736 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
246OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,37 tok/s TG
Prefill 2.309 · TTFT 1.056 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
247Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.309,27 tok/s TG
Prefill 10.749 · TTFT 7.401 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
248Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
723,83 tok/s TG
Prefill 9.782 · TTFT 2.438 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
249Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,69 tok/s TG
Prefill 5.251 · TTFT 367 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
250Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.349,73 tok/s TG
Prefill 11.193 · TTFT 7.579 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M