Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
317,00 tok/s TG
Prefill 14.849 · TTFT 2.492 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
2Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,35 tok/s TG
Prefill 11.565 · TTFT 1.219 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
3Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,39 tok/s TG
Prefill 5.909 · TTFT 412 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
4Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,25 tok/s TG
Prefill 8.339 · TTFT 298 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
5Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,01 tok/s TG
Prefill 10.663 · TTFT 3.085 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
6Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,39 tok/s TG
Prefill 7.898 · TTFT 1.797 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
7Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,91 tok/s TG
Prefill 4.040 · TTFT 608 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
8Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
385,85 tok/s TG
Prefill 16.933 · TTFT 1.925 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
9Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
223,20 tok/s TG
Prefill 12.589 · TTFT 1.123 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
10Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,94 tok/s TG
Prefill 6.450 · TTFT 379 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
11Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,94 tok/s TG
Prefill 3.492 · TTFT 6.829 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
12Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,96 tok/s TG
Prefill 2.540 · TTFT 4.155 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
13Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,58 tok/s TG
Prefill 1.653 · TTFT 1.169 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
14Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,01 tok/s TG
Prefill 3.668 · TTFT 6.469 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
15Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,43 tok/s TG
Prefill 2.659 · TTFT 3.956 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
16Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,61 tok/s TG
Prefill 1.738 · TTFT 1.111 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
17Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,22 tok/s TG
Prefill 3.297 · TTFT 7.376 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
18Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,07 tok/s TG
Prefill 2.389 · TTFT 4.453 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
19Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,58 tok/s TG
Prefill 1.461 · TTFT 1.321 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
20Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,99 tok/s TG
Prefill 3.096 · TTFT 7.876 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
21Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,89 tok/s TG
Prefill 2.246 · TTFT 4.750 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
22Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,15 tok/s TG
Prefill 1.375 · TTFT 1.403 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
23Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,41 tok/s TG
Prefill 3.120 · TTFT 7.835 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
24Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,01 tok/s TG
Prefill 2.225 · TTFT 4.791 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
25Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,50 tok/s TG
Prefill 1.394 · TTFT 1.386 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
26Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
91,92 tok/s TG
Prefill 3.113 · TTFT 7.635 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
27Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,45 tok/s TG
Prefill 2.269 · TTFT 4.646 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
28Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,91 tok/s TG
Prefill 1.421 · TTFT 1.356 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
29Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,01 tok/s TG
Prefill 1.371 · TTFT 1.564 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
30Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,06 tok/s TG
Prefill 2.421 · TTFT 9.812 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
31Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,20 tok/s TG
Prefill 1.745 · TTFT 6.003 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
32Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,97 tok/s TG
Prefill 1.121 · TTFT 1.720 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
33NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
725,25 tok/s TG
Prefill 16.303 · TTFT 1.813 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
34NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
466,72 tok/s TG
Prefill 12.079 · TTFT 1.048 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
35NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,66 tok/s TG
Prefill 6.076 · TTFT 355 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
36NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
709,02 tok/s TG
Prefill 16.443 · TTFT 1.805 ms
10×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
37NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
462,42 tok/s TG
Prefill 11.388 · TTFT 1.082 ms
5×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
38NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,38 tok/s TG
Prefill 5.434 · TTFT 411 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
39NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1
218,77 tok/s TG
Prefill - · TTFT 54 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
40Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,38 tok/s TG
Prefill 14.373 · TTFT 1.721 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
41Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
417,52 tok/s TG
Prefill 12.747 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
42Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 8.225 · TTFT 296 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
43Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
615,23 tok/s TG
Prefill 13.720 · TTFT 797 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
44Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
709,24 tok/s TG
Prefill 11.744 · TTFT 2.430 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
45Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
728,31 tok/s TG
Prefill 10.081 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
46Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
884,45 tok/s TG
Prefill 33.614 · TTFT 1.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
47Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
913,32 tok/s TG
Prefill 38.043 · TTFT 1.193 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
48Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
954,95 tok/s TG
Prefill 31.797 · TTFT 1.633 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
49Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,15 tok/s TG
Prefill 33.319 · TTFT 976 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
50gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.425,74 tok/s TG
Prefill 35.639 · TTFT 560 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
51Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
418,77 tok/s TG
Prefill 17.642 · TTFT 1.399 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
52Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
584,06 tok/s TG
Prefill 25.276 · TTFT 1.075 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
53Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,09 tok/s TG
Prefill 15.257 · TTFT 775 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
54Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,28 tok/s TG
Prefill 20.534 · TTFT 617 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
55Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,14 tok/s TG
Prefill 7.814 · TTFT 243 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
56Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,74 tok/s TG
Prefill 9.683 · TTFT 204 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
57NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,84 tok/s TG
Prefill 3.760 · TTFT 5.878 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
58NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,14 tok/s TG
Prefill 3.027 · TTFT 3.561 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
59NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,44 tok/s TG
Prefill 1.717 · TTFT 1.294 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
60NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.562,27 tok/s TG
Prefill 2.593 · TTFT 34.854 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
61NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
795,03 tok/s TG
Prefill 2.378 · TTFT 15.951 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
62NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,32 tok/s TG
Prefill 1.225 · TTFT 2.121 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
63Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,39 tok/s TG
Prefill 3.269 · TTFT 6.004 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
64Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,45 tok/s TG
Prefill 2.547 · TTFT 3.826 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
65Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,26 tok/s TG
Prefill 1.798 · TTFT 1.074 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
66Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
833,03 tok/s TG
Prefill - · TTFT 213 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
67Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
490,51 tok/s TG
Prefill - · TTFT 177 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
68Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,86 tok/s TG
Prefill - · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
69Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
283 Pkt
91,3% · 283/310 Aufg. · 2.384,4 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
70Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
119 Pkt
38,4% · 119/310 Aufg. · 87,9 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
71Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,92 tok/s TG
Prefill - · TTFT 227 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
72Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
297 Pkt
95,8% · 297/310 Aufg. · 2.578,6 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4
73Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,30 tok/s TG
Prefill - · TTFT 165 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
74Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,47 tok/s TG
Prefill - · TTFT 98 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
75Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
289 Pkt
93,2% · 289/310 Aufg. · 2.504,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
76Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
164 Pkt
52,9% · 164/310 Aufg. · 208,4 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic310NVFP4
77Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
115 Pkt
37,1% · 115/310 Aufg. · 99,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
78Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
424,23 tok/s TG
Prefill - · TTFT 1.608 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
79Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
302,61 tok/s TG
Prefill - · TTFT 612 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
80Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
77,21 tok/s TG
Prefill - · TTFT 344 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
81Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
846,62 tok/s TG
Prefill - · TTFT 238 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
82Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
569,97 tok/s TG
Prefill - · TTFT 160 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
83Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,71 tok/s TG
Prefill - · TTFT 160 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
84Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
207 Pkt
98,6% · 207/210 Aufg. · 1.080,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
85Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
108 Pkt
51,4% · 108/210 Aufg. · 72,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
86Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,27 tok/s TG
Prefill - · TTFT 2.092 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
87Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
257,18 tok/s TG
Prefill - · TTFT 3.386 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
88Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,23 tok/s TG
Prefill - · TTFT 590 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMcodex_cliNVFP4
89Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
206 Pkt
98,1% · 206/210 Aufg. · 1.001,2 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
90Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
145 Pkt
69,0% · 145/210 Aufg. · 145,4 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMdeterministic210NVFP4
91Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
388,05 tok/s TG
Prefill 16.198 · TTFT 2.053 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
92Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
343,90 tok/s TG
Prefill 9.629 · TTFT 1.973 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
93Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,60 tok/s TG
Prefill 4.438 · TTFT 606 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
94Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 57,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMBuzzwordTrainAWQ
95Qwen3.8-Flash-Next180BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
107 Pkt
53,5% · 107/200 Aufg. · 38,9 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
96Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
110 Pkt
55,0% · 110/200 Aufg. · 28,7 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
97Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
101 Pkt
50,5% · 101/200 Aufg. · 36,8 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
98Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
193 Pkt
96,5% · 193/200 Aufg. · 3.667,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
99Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
87 Pkt
43,5% · 87/200 Aufg. · 19,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
100Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 36,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
101Nemotron-Cascade-2-30B-A3B30BNVIDIA HarnessbenchmarkDecision-Benchmark V 1.0
159 Pkt
79,5% · 159/200 Aufg. · 35,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
102Qwen3.8-27B-Uncensored27BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 29,9 s
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMvllmNVFP4
103Nemotron-Cascade-2-30B-A3B30BNVIDIA HarnessbenchmarkDecision-Benchmark V 1.0
159 Pkt
79,5% · 159/200 Aufg. · 21,0 s
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMvllmAWQ
104Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
178,53 tok/s TG
Prefill 3.756 · TTFT 10.700 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
105Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,45 tok/s TG
Prefill 2.962 · TTFT 5.639 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
106Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,09 tok/s TG
Prefill 1.399 · TTFT 1.755 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
107SmolLM2-1.7B-Instruct1.7BHuggingFaceTB PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
531,74 tok/s TG
Prefill 44.141 · TTFT 1.002 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
108SmolLM2-1.7B-Instruct1.7BHuggingFaceTB PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
338,72 tok/s TG
Prefill 33.135 · TTFT 574 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
109SmolLM2-1.7B-Instruct1.7BHuggingFaceTB PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,05 tok/s TG
Prefill 13.702 · TTFT 223 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
110Phi-3.5-mini-instruct3.8Bmicrosoft PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
301,98 tok/s TG
Prefill 19.406 · TTFT 1.945 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
111Phi-3.5-mini-instruct3.8Bmicrosoft PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,39 tok/s TG
Prefill 14.992 · TTFT 1.125 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
112Phi-3.5-mini-instruct3.8Bmicrosoft PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
39,32 tok/s TG
Prefill 6.700 · TTFT 380 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
113gemma-2-2b-it2BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
322,89 tok/s TG
Prefill 27.208 · TTFT 972 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
114gemma-2-2b-it2BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,26 tok/s TG
Prefill 21.013 · TTFT 558 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
115gemma-2-2b-it2BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,77 tok/s TG
Prefill 8.388 · TTFT 218 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
116Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
404,99 tok/s TG
Prefill 14.538 · TTFT 2.823 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
117Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
279,01 tok/s TG
Prefill 11.575 · TTFT 1.408 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
118Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,55 tok/s TG
Prefill 5.171 · TTFT 476 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
119Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
465,73 tok/s TG
Prefill 23.398 · TTFT 1.915 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
120Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,54 tok/s TG
Prefill 19.091 · TTFT 830 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
121Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,35 tok/s TG
Prefill 8.149 · TTFT 302 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
122Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
717,61 tok/s TG
Prefill 52.503 · TTFT 1.022 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
123Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
479,20 tok/s TG
Prefill 40.760 · TTFT 356 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
124Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,26 tok/s TG
Prefill 15.904 · TTFT 156 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
125Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
320,40 tok/s TG
Prefill 19.188 · TTFT 3.026 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
126Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
221,06 tok/s TG
Prefill 15.907 · TTFT 999 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
127Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,44 tok/s TG
Prefill 6.967 · TTFT 349 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
128Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
387,65 tok/s TG
Prefill 32.764 · TTFT 2.280 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
129Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
252,00 tok/s TG
Prefill 26.134 · TTFT 576 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
130Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
55,89 tok/s TG
Prefill 10.932 · TTFT 223 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
131Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
384,19 tok/s TG
Prefill 49.306 · TTFT 1.939 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
132Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
260,24 tok/s TG
Prefill 38.946 · TTFT 372 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
133Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,53 tok/s TG
Prefill 14.803 · TTFT 166 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
134Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
355,86 tok/s TG
Prefill 24.866 · TTFT 2.634 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
135Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
253,98 tok/s TG
Prefill 19.902 · TTFT 780 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
136Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,34 tok/s TG
Prefill 7.155 · TTFT 346 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
137Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,60 tok/s TG
Prefill 1.882 · TTFT 2.287 ms
10×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
138Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,90 tok/s TG
Prefill 3.268 · TTFT 1.317 ms
5×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
139Qwen3.8-27B-Uncensored27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,30 tok/s TG
Prefill 11.550 · TTFT 373 ms
1×2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclawNVFP4
140Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
179,02 tok/s TG
Prefill 3.915 · TTFT 10.290 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
141Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,17 tok/s TG
Prefill 3.097 · TTFT 5.385 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
142Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,97 tok/s TG
Prefill 1.455 · TTFT 1.686 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
143Qwen3-14B14BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
280,80 tok/s TG
Prefill 8.760 · TTFT 5.247 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
144Qwen3-14B14BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,18 tok/s TG
Prefill 7.101 · TTFT 2.296 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
145Qwen3-14B14BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
44,22 tok/s TG
Prefill 3.257 · TTFT 748 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
146Qwen3-8B8.2BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
315,16 tok/s TG
Prefill 13.007 · TTFT 3.960 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
147Qwen3-8B8.2BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
224,00 tok/s TG
Prefill 10.578 · TTFT 1.518 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
148Qwen3-8B8.2BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,36 tok/s TG
Prefill 4.818 · TTFT 505 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
149Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
442,02 tok/s TG
Prefill 16.333 · TTFT 3.286 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
150Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
326,73 tok/s TG
Prefill 13.426 · TTFT 1.202 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
151Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,23 tok/s TG
Prefill 5.975 · TTFT 411 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
152Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,00 tok/s TG
Prefill 470 · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
153Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,00 tok/s TG
Prefill - · TTFT 0 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
154Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
489,72 tok/s TG
Prefill 21.352 · TTFT 2.183 ms
10×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliAWQ
155Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
254,69 tok/s TG
Prefill 14.644 · TTFT 1.771 ms
5×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliAWQ
156Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
53,50 tok/s TG
Prefill 7.717 · TTFT 319 ms
1×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliAWQ
157Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
503,33 tok/s TG
Prefill 112.346 · TTFT 242 ms
10×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliFP8
158Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,23 tok/s TG
Prefill 81.661 · TTFT 159 ms
5×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliFP8
159Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,80 tok/s TG
Prefill 20.717 · TTFT 121 ms
1×NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAMvLLMopenclaw_cliFP8
160GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,75 tok/s TG
Prefill 987 · TTFT 26.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
161GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,94 tok/s TG
Prefill 762 · TTFT 15.666 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
162GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,01 tok/s TG
Prefill 441 · TTFT 4.837 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
163Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.100,69 tok/s TG
Prefill 27.110 · TTFT 739 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
164Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
608,35 tok/s TG
Prefill 23.343 · TTFT 414 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
165Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,73 tok/s TG
Prefill 15.397 · TTFT 126 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
166gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,40 tok/s TG
Prefill 15.615 · TTFT 1.677 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
167gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,78 tok/s TG
Prefill 12.359 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
168gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,12 tok/s TG
Prefill 7.867 · TTFT 251 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
169Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,96 tok/s TG
Prefill 3.010 · TTFT 18.082 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQ
170Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,88 tok/s TG
Prefill 2.387 · TTFT 7.059 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQ
171Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,51 tok/s TG
Prefill 1.097 · TTFT 2.256 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQ
172Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
201,02 tok/s TG
Prefill 13.392 · TTFT 2.808 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
173Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
121,19 tok/s TG
Prefill 9.219 · TTFT 1.374 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
174Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
39,59 tok/s TG
Prefill 2.033 · TTFT 986 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
175Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,64 tok/s TG
Prefill 13.127 · TTFT 2.817 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
176Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,10 tok/s TG
Prefill 10.048 · TTFT 1.358 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
177Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
40,09 tok/s TG
Prefill 2.094 · TTFT 943 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
178Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,65 tok/s TG
Prefill 1.849 · TTFT 17.975 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
179Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,88 tok/s TG
Prefill 1.520 · TTFT 10.032 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
180Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,65 tok/s TG
Prefill 702 · TTFT 3.160 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
181Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,80 tok/s TG
Prefill 2.181 · TTFT 17.048 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
182Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,94 tok/s TG
Prefill 1.472 · TTFT 9.827 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
183Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,26 tok/s TG
Prefill 856 · TTFT 2.877 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
184Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,89 tok/s TG
Prefill 2.286 · TTFT 17.114 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
185Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,93 tok/s TG
Prefill 1.679 · TTFT 9.606 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
186Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,29 tok/s TG
Prefill 858 · TTFT 2.871 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
187Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,01 tok/s TG
Prefill 6.125 · TTFT 5.956 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
188Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,42 tok/s TG
Prefill 5.042 · TTFT 3.214 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
189Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,72 tok/s TG
Prefill 2.235 · TTFT 1.090 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
190Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
289,48 tok/s TG
Prefill 11.717 · TTFT 3.710 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
191Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
178,74 tok/s TG
Prefill 9.274 · TTFT 1.816 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
192Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,42 tok/s TG
Prefill 4.105 · TTFT 597 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
193Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,30 tok/s TG
Prefill 4.368 · TTFT 9.029 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
194Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,24 tok/s TG
Prefill 3.416 · TTFT 5.086 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
195Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,00 tok/s TG
Prefill 1.583 · TTFT 1.597 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
196Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
262,93 tok/s TG
Prefill 8.472 · TTFT 4.535 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
197Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
146,19 tok/s TG
Prefill 6.653 · TTFT 2.534 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
198Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,53 tok/s TG
Prefill 2.874 · TTFT 857 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
199Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,41 tok/s TG
Prefill 28.681 · TTFT 928 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
200Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
418,21 tok/s TG
Prefill 21.951 · TTFT 535 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
201Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,55 tok/s TG
Prefill 8.176 · TTFT 245 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
202Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
514,52 tok/s TG
Prefill 22.477 · TTFT 1.541 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
203Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
365,08 tok/s TG
Prefill 17.147 · TTFT 895 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
204Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
146,76 tok/s TG
Prefill 6.990 · TTFT 350 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
205Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,42 tok/s TG
Prefill 16.357 · TTFT 2.480 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
206Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,44 tok/s TG
Prefill 13.079 · TTFT 1.402 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
207Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
109,52 tok/s TG
Prefill 5.943 · TTFT 462 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
208command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,47 tok/s TG
Prefill 3.802 · TTFT 14.501 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
209command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,67 tok/s TG
Prefill 2.956 · TTFT 8.171 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
210command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,11 tok/s TG
Prefill 1.404 · TTFT 2.484 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
211GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
276,46 tok/s TG
Prefill 11.804 · TTFT 2.833 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
212GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
197,32 tok/s TG
Prefill 9.348 · TTFT 1.552 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
213GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,64 tok/s TG
Prefill 3.471 · TTFT 630 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
214Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
197,25 tok/s TG
Prefill 5.040 · TTFT 7.497 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
215Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
111,56 tok/s TG
Prefill 3.912 · TTFT 4.256 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
216Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,25 tok/s TG
Prefill 1.890 · TTFT 1.299 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
217Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,83 tok/s TG
Prefill 26.016 · TTFT 1.347 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
218Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
410,37 tok/s TG
Prefill 19.698 · TTFT 777 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
219Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,13 tok/s TG
Prefill 8.147 · TTFT 302 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
220Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
248,32 tok/s TG
Prefill 6.596 · TTFT 4.963 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
221Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,08 tok/s TG
Prefill 5.398 · TTFT 2.776 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
222Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,16 tok/s TG
Prefill 2.495 · TTFT 886 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
223Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
658,68 tok/s TG
Prefill 27.910 · TTFT 964 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
224Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
450,20 tok/s TG
Prefill 21.244 · TTFT 558 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
225Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
172,47 tok/s TG
Prefill 8.214 · TTFT 241 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
226Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
664,59 tok/s TG
Prefill 27.704 · TTFT 965 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
227Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
453,61 tok/s TG
Prefill 21.156 · TTFT 557 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
228Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
172,52 tok/s TG
Prefill 8.354 · TTFT 237 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
229Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
712,04 tok/s TG
Prefill 35.143 · TTFT 1.137 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
230Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
462,23 tok/s TG
Prefill 24.899 · TTFT 645 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
231Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
147,92 tok/s TG
Prefill 11.709 · TTFT 234 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
232gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,03 tok/s TG
Prefill 5.472 · TTFT 5.845 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
233gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,75 tok/s TG
Prefill 4.220 · TTFT 3.249 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
234gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,84 tok/s TG
Prefill 1.988 · TTFT 997 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
235Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
262,60 tok/s TG
Prefill 7.019 · TTFT 5.005 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
236Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
153,33 tok/s TG
Prefill 5.312 · TTFT 2.861 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
237Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,99 tok/s TG
Prefill 2.848 · TTFT 865 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
238Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
515,26 tok/s TG
Prefill 31.910 · TTFT 1.107 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
239Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
367,00 tok/s TG
Prefill 24.948 · TTFT 625 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
240Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,20 tok/s TG
Prefill 10.821 · TTFT 225 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
241gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
251,07 tok/s TG
Prefill 7.025 · TTFT 4.495 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
242gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,19 tok/s TG
Prefill 5.535 · TTFT 2.477 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
243gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,87 tok/s TG
Prefill 2.641 · TTFT 751 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
244Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
547,72 tok/s TG
Prefill 30.727 · TTFT 1.142 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
245Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
386,05 tok/s TG
Prefill 23.773 · TTFT 648 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
246Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
161,14 tok/s TG
Prefill 10.675 · TTFT 228 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
247Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
536,72 tok/s TG
Prefill 9.810 · TTFT 3.224 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
248Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
329,05 tok/s TG
Prefill 8.161 · TTFT 1.778 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
249Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,96 tok/s TG
Prefill 3.773 · TTFT 568 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
250Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
534,84 tok/s TG
Prefill 10.455 · TTFT 3.204 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ