Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
344,40 tok/s TG
Prefill 16.771 · TTFT 2.037 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
2Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,85 tok/s TG
Prefill 14.238 · TTFT 934 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
3Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,79 tok/s TG
Prefill 5.764 · TTFT 344 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
4Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
623,04 tok/s TG
Prefill 6.697 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
5Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
646,94 tok/s TG
Prefill 10.489 · TTFT 10.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
6Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
615,23 tok/s TG
Prefill 13.720 · TTFT 797 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
7gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
575,74 tok/s TG
Prefill 4.496 · TTFT 3.743 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
8Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
709,24 tok/s TG
Prefill 11.744 · TTFT 2.430 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
9Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
728,31 tok/s TG
Prefill 10.081 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
10Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,14 tok/s TG
Prefill 9.553 · TTFT 2.416 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
11Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
884,45 tok/s TG
Prefill 33.614 · TTFT 1.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
12gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,59 tok/s TG
Prefill 12.381 · TTFT 1.885 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
13Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
913,32 tok/s TG
Prefill 38.043 · TTFT 1.193 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
14Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
900,71 tok/s TG
Prefill 9.991 · TTFT 2.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
15Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
899,11 tok/s TG
Prefill 13.942 · TTFT 2.150 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
16Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
954,95 tok/s TG
Prefill 31.797 · TTFT 1.633 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
17Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
985,75 tok/s TG
Prefill 7.733 · TTFT 2.448 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
18Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
997,65 tok/s TG
Prefill 7.725 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
19NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.005,67 tok/s TG
Prefill 7.555 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
20Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.055,44 tok/s TG
Prefill 10.341 · TTFT 9.706 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
21Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
944,04 tok/s TG
Prefill 13.438 · TTFT 2.113 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
22Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,15 tok/s TG
Prefill 33.319 · TTFT 976 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
23gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.103,42 tok/s TG
Prefill 5.051 · TTFT 11.207 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
24NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.154,42 tok/s TG
Prefill 8.806 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
25gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.348,35 tok/s TG
Prefill 18.078 · TTFT 1.302 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
26gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.105,79 tok/s TG
Prefill 14.121 · TTFT 1.691 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
27gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.425,74 tok/s TG
Prefill 35.639 · TTFT 560 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
28Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
799,04 tok/s TG
Prefill 7.237 · TTFT 2.650 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
29Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.439,36 tok/s TG
Prefill 8.063 · TTFT 7.868 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
30Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
818,85 tok/s TG
Prefill 7.089 · TTFT 2.658 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
31Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.499,44 tok/s TG
Prefill 8.022 · TTFT 7.851 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
32Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
814,30 tok/s TG
Prefill 6.898 · TTFT 2.629 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
33Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.476,12 tok/s TG
Prefill 7.819 · TTFT 7.689 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
34Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
869,38 tok/s TG
Prefill 11.044 · TTFT 2.242 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
35Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.528,71 tok/s TG
Prefill 17.513 · TTFT 6.225 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
36Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
803,48 tok/s TG
Prefill 9.780 · TTFT 2.187 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
37Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,55 tok/s TG
Prefill 6.134 · TTFT 2.760 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
38Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
890,62 tok/s TG
Prefill 6.480 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
39North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
859,15 tok/s TG
Prefill 7.281 · TTFT 2.530 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
40Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
888,96 tok/s TG
Prefill 12.945 · TTFT 2.202 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
41Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
959,22 tok/s TG
Prefill 7.286 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
42Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.525,69 tok/s TG
Prefill 10.623 · TTFT 6.806 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
43Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.604,55 tok/s TG
Prefill 6.804 · TTFT 8.073 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
44Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.586,19 tok/s TG
Prefill 7.391 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
45North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.573,04 tok/s TG
Prefill 8.004 · TTFT 7.551 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
46Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.617,88 tok/s TG
Prefill 13.894 · TTFT 6.893 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
47Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.706,21 tok/s TG
Prefill 8.777 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
48Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.623,26 tok/s TG
Prefill 10.509 · TTFT 7.259 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
49Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.653,11 tok/s TG
Prefill 13.572 · TTFT 6.808 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
50Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.623,15 tok/s TG
Prefill 10.707 · TTFT 7.140 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
51Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.645,78 tok/s TG
Prefill 14.123 · TTFT 6.609 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
52gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.755,52 tok/s TG
Prefill 13.910 · TTFT 5.964 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
53Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.784,65 tok/s TG
Prefill 8.304 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
54NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.775,62 tok/s TG
Prefill 8.642 · TTFT 6.861 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
55Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.774,36 tok/s TG
Prefill 7.850 · TTFT 6.996 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
56gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.981,08 tok/s TG
Prefill 15.983 · TTFT 5.309 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
57NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.144,30 tok/s TG
Prefill 10.533 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
58gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.412,27 tok/s TG
Prefill 19.677 · TTFT 4.107 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
59Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
584,06 tok/s TG
Prefill 25.276 · TTFT 1.075 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
60Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,28 tok/s TG
Prefill 20.534 · TTFT 617 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
61Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,74 tok/s TG
Prefill 9.683 · TTFT 204 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
62Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,00 tok/s TG
Prefill 470 · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
63Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,00 tok/s TG
Prefill - · TTFT 0 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
64glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
65glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.057 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclaw
66Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
781,43 tok/s TG
Prefill 3.666 · TTFT 16.232 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
67Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
456,52 tok/s TG
Prefill 3.165 · TTFT 6.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
68Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,95 tok/s TG
Prefill 2.846 · TTFT 964 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
69glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.045 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
70glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
71glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 174 · TTFT 10.848 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
72MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,00 tok/s TG
Prefill 96 · TTFT 109.168 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
73MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,30 tok/s TG
Prefill 94 · TTFT 111.517 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
74MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,22 tok/s TG
Prefill 53 · TTFT 44.470 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
75MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,78 tok/s TG
Prefill 95 · TTFT 110.730 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
76MiniMax-M2.7230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,42 tok/s TG
Prefill 83 · TTFT 117.412 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
77Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,23 tok/s TG
Prefill 75 · TTFT 110.236 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
78Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,11 tok/s TG
Prefill 75 · TTFT 158.430 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
79Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,93 tok/s TG
Prefill 64 · TTFT 30.298 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
80Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,99 tok/s TG
Prefill 74 · TTFT 109.505 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
81Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,28 tok/s TG
Prefill 69 · TTFT 119.823 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
82NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,36 tok/s TG
Prefill 90 · TTFT 96.800 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
83NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,14 tok/s TG
Prefill 93 · TTFT 194.178 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
84NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,91 tok/s TG
Prefill 82 · TTFT 26.277 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
85NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,90 tok/s TG
Prefill 88 · TTFT 98.810 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
86NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,19 tok/s TG
Prefill 96 · TTFT 191.977 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
87NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,07 tok/s TG
Prefill 78 · TTFT 27.484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
88Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,96 tok/s TG
Prefill 48 · TTFT 187.060 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
89Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,93 tok/s TG
Prefill 51 · TTFT 179.975 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
90Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,29 tok/s TG
Prefill 36 · TTFT 58.861 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
91Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,10 tok/s TG
Prefill 8 · TTFT 263.746 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
92Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,94 tok/s TG
Prefill 51 · TTFT 180.358 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
93Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,28 tok/s TG
Prefill 30 · TTFT 74.267 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
94Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,09 tok/s TG
Prefill 8 · TTFT 280.190 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
95Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
835,13 tok/s TG
Prefill 3.499 · TTFT 16.577 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
96Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
465,82 tok/s TG
Prefill 3.019 · TTFT 6.496 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
97Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
146,11 tok/s TG
Prefill 2.580 · TTFT 1.064 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
98Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,97 tok/s TG
Prefill 45 · TTFT 191.746 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
99Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 50 · TTFT 181.487 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
100Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,63 tok/s TG
Prefill 53 · TTFT 50.822 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
101Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,09 tok/s TG
Prefill 8 · TTFT 260.023 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
102Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
791,09 tok/s TG
Prefill 3.559 · TTFT 16.497 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
103Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
470,52 tok/s TG
Prefill 3.067 · TTFT 6.420 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
104Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 48 · TTFT 182.972 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
105Laguna-M.1225.8BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,80 tok/s TG
Prefill 49 · TTFT 183.700 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
106Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,48 tok/s TG
Prefill 7.448 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
107Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
882,70 tok/s TG
Prefill 6.523 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
108Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
292,74 tok/s TG
Prefill 5.076 · TTFT 381 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
109Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.589,11 tok/s TG
Prefill 6.805 · TTFT 8.073 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
110Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
869,89 tok/s TG
Prefill 6.141 · TTFT 2.760 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
111Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
268,04 tok/s TG
Prefill 5.498 · TTFT 360 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
112Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.560,53 tok/s TG
Prefill 10.558 · TTFT 6.806 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
113Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
824,94 tok/s TG
Prefill 9.828 · TTFT 2.187 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
114Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,11 tok/s TG
Prefill 6.786 · TTFT 284 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
115glm-5.2-colibri744BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 185 · TTFT 10.186 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclaw
116minimax-m2230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,51 tok/s TG
Prefill 98 · TTFT 111.122 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
117minimax-m2230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,67 tok/s TG
Prefill 86 · TTFT 121.821 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
118minimax-m2230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,22 tok/s TG
Prefill 55 · TTFT 42.011 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
119gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.995,37 tok/s TG
Prefill 16.158 · TTFT 5.309 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
120gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.135,00 tok/s TG
Prefill 15.100 · TTFT 1.661 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
121gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
395,20 tok/s TG
Prefill 10.820 · TTFT 183 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
122gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.274,68 tok/s TG
Prefill 6.447 · TTFT 8.887 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
123gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,35 tok/s TG
Prefill 5.796 · TTFT 3.127 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
124gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
281,92 tok/s TG
Prefill 3.493 · TTFT 568 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
125Mistral-Medium-3.5-128B128BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
141,57 tok/s TG
Prefill 2.054 · TTFT 71.488 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
126Mistral-Medium-3.5-128B128BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,58 tok/s TG
Prefill 1.877 · TTFT 22.218 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
127Mistral-Medium-3.5-128B128BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,65 tok/s TG
Prefill 1.170 · TTFT 2.148 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
128Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,05 tok/s TG
Prefill 1.609 · TTFT 71.138 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
129Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,09 tok/s TG
Prefill 1.590 · TTFT 21.529 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
130Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,71 tok/s TG
Prefill 1.011 · TTFT 2.126 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
131NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,88 tok/s TG
Prefill 2.709 · TTFT 21.268 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
132NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
348,02 tok/s TG
Prefill 2.385 · TTFT 7.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
133NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
129,00 tok/s TG
Prefill 1.909 · TTFT 1.129 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
134Mistral-Small-4-119B-2603119BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
959,57 tok/s TG
Prefill 8.078 · TTFT 11.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
135Mistral-Small-4-119B-2603119BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
544,25 tok/s TG
Prefill 6.975 · TTFT 4.321 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
136Mistral-Small-4-119B-2603119BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,78 tok/s TG
Prefill 4.035 · TTFT 667 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
137Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,17 tok/s TG
Prefill 2.414 · TTFT 43.060 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
138Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,74 tok/s TG
Prefill 2.668 · TTFT 13.115 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
139Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,80 tok/s TG
Prefill 1.743 · TTFT 1.412 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
140Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
364,07 tok/s TG
Prefill 2.683 · TTFT 30.535 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
141Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,16 tok/s TG
Prefill 2.465 · TTFT 9.980 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
142Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,77 tok/s TG
Prefill 2.291 · TTFT 1.070 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
143Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
174,90 tok/s TG
Prefill 848 · TTFT 34.870 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
144Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,55 tok/s TG
Prefill 986 · TTFT 17.763 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
145Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,30 tok/s TG
Prefill 979 · TTFT 2.203 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
146Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
460,00 tok/s TG
Prefill 3.423 · TTFT 23.571 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
147Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
243,19 tok/s TG
Prefill 3.159 · TTFT 7.524 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
148Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,06 tok/s TG
Prefill 2.840 · TTFT 777 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
149Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.489,06 tok/s TG
Prefill 8.018 · TTFT 7.851 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
150Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
812,57 tok/s TG
Prefill 7.150 · TTFT 2.658 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
151Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
267,12 tok/s TG
Prefill 5.400 · TTFT 357 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
152Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.520,35 tok/s TG
Prefill 7.808 · TTFT 7.689 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
153Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
829,61 tok/s TG
Prefill 7.025 · TTFT 2.629 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
154Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,36 tok/s TG
Prefill 5.147 · TTFT 375 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
155Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.481,23 tok/s TG
Prefill 8.109 · TTFT 7.868 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
156Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
812,21 tok/s TG
Prefill 7.214 · TTFT 2.650 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
157Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,48 tok/s TG
Prefill 5.318 · TTFT 363 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
158Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
476,88 tok/s TG
Prefill 5.163 · TTFT 21.750 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
159Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
255,67 tok/s TG
Prefill 5.060 · TTFT 6.595 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
160Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,33 tok/s TG
Prefill 2.360 · TTFT 1.241 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
161Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
473,96 tok/s TG
Prefill 5.347 · TTFT 21.026 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
162Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,73 tok/s TG
Prefill 5.071 · TTFT 5.931 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
163Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,44 tok/s TG
Prefill 3.289 · TTFT 747 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
164OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
480,01 tok/s TG
Prefill 5.022 · TTFT 21.777 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
165OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
255,53 tok/s TG
Prefill 5.057 · TTFT 6.588 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
166OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,35 tok/s TG
Prefill 3.427 · TTFT 714 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
167Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.639,00 tok/s TG
Prefill 13.790 · TTFT 6.893 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
168Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
905,02 tok/s TG
Prefill 13.235 · TTFT 2.202 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
169Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
303,58 tok/s TG
Prefill 8.051 · TTFT 303 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
170Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.653,28 tok/s TG
Prefill 10.581 · TTFT 7.259 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
171Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
909,92 tok/s TG
Prefill 9.716 · TTFT 2.416 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
172Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
304,38 tok/s TG
Prefill 7.815 · TTFT 312 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
173Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.689,95 tok/s TG
Prefill 14.458 · TTFT 6.609 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
174Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
938,21 tok/s TG
Prefill 13.797 · TTFT 2.113 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
175Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
311,28 tok/s TG
Prefill 8.147 · TTFT 299 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
176Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.670,49 tok/s TG
Prefill 10.926 · TTFT 7.140 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
177Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
926,17 tok/s TG
Prefill 9.914 · TTFT 2.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
178Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
312,09 tok/s TG
Prefill 8.022 · TTFT 304 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
179Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.658,09 tok/s TG
Prefill 13.451 · TTFT 6.808 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
180Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
910,76 tok/s TG
Prefill 14.150 · TTFT 2.150 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
181Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
304,63 tok/s TG
Prefill 8.163 · TTFT 298 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
182NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.773,53 tok/s TG
Prefill 8.720 · TTFT 6.861 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
183NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,80 tok/s TG
Prefill 7.787 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
184NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,96 tok/s TG
Prefill 5.493 · TTFT 396 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
185Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.768,14 tok/s TG
Prefill 8.360 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
186Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,26 tok/s TG
Prefill 7.851 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
187Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,78 tok/s TG
Prefill 4.249 · TTFT 510 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
188Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.791,48 tok/s TG
Prefill 7.972 · TTFT 6.996 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
189Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,02 tok/s TG
Prefill 7.777 · TTFT 2.448 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
190Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
357,11 tok/s TG
Prefill 2.410 · TTFT 1.169 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
191Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
546,87 tok/s TG
Prefill 3.310 · TTFT 19.828 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
192Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
288,04 tok/s TG
Prefill 3.368 · TTFT 6.271 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
193Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,42 tok/s TG
Prefill 1.538 · TTFT 1.279 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
194Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
645,14 tok/s TG
Prefill 10.717 · TTFT 14.083 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
195Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,30 tok/s TG
Prefill 8.069 · TTFT 4.298 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
196Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
94,49 tok/s TG
Prefill 6.040 · TTFT 447 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
197Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,04 tok/s TG
Prefill 10.434 · TTFT 9.706 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
198Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
569,52 tok/s TG
Prefill 9.238 · TTFT 3.017 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
199Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
147,70 tok/s TG
Prefill 3.978 · TTFT 814 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
200Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,49 tok/s TG
Prefill 6.861 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
201Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
350,14 tok/s TG
Prefill 6.541 · TTFT 4.589 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
202Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
94,15 tok/s TG
Prefill 3.697 · TTFT 735 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
203Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.008,92 tok/s TG
Prefill 9.626 · TTFT 9.750 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
204Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
571,60 tok/s TG
Prefill 9.450 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
205Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
148,00 tok/s TG
Prefill 5.910 · TTFT 383 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
206gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.104,30 tok/s TG
Prefill 5.032 · TTFT 11.207 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
207gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
588,32 tok/s TG
Prefill 4.584 · TTFT 3.743 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
208gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
151,50 tok/s TG
Prefill 4.094 · TTFT 483 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
209Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.532,95 tok/s TG
Prefill 17.861 · TTFT 6.225 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
210Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
876,87 tok/s TG
Prefill 11.325 · TTFT 2.242 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
211Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,32 tok/s TG
Prefill 11.230 · TTFT 219 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
212Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.253,31 tok/s TG
Prefill 5.076 · TTFT 10.589 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
213Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
726,51 tok/s TG
Prefill 4.456 · TTFT 4.078 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
214Qwen3-Coder-Next79.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,22 tok/s TG
Prefill 2.455 · TTFT 1.020 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
215North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.621,00 tok/s TG
Prefill 8.046 · TTFT 7.551 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
216North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
876,14 tok/s TG
Prefill 7.415 · TTFT 2.530 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
217North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,43 tok/s TG
Prefill 2.836 · TTFT 699 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
218MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,86 tok/s TG
Prefill 73 · TTFT 138.925 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
219MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,91 tok/s TG
Prefill 71 · TTFT 147.578 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
220MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,12 tok/s TG
Prefill 50 · TTFT 45.694 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
221MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,31 tok/s TG
Prefill 119 · TTFT 88.713 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
222MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,00 tok/s TG
Prefill 120 · TTFT 140.976 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
223MiniMax-M2.5230BMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,02 tok/s TG
Prefill 65 · TTFT 35.247 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
224Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
724,52 tok/s TG
Prefill 181 · TTFT 7.226 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
225Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
392,12 tok/s TG
Prefill 125 · TTFT 981 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
226Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,09 tok/s TG
Prefill 36 · TTFT 233 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
227Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.753,82 tok/s TG
Prefill 9.267 · TTFT 7.329 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
228Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
967,89 tok/s TG
Prefill 8.250 · TTFT 2.709 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
229Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
309,54 tok/s TG
Prefill 5.382 · TTFT 511 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
230Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.757,37 tok/s TG
Prefill 9.025 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
231Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
966,13 tok/s TG
Prefill 8.310 · TTFT 2.703 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
232Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
309,93 tok/s TG
Prefill 4.887 · TTFT 562 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
233Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.740,43 tok/s TG
Prefill 9.653 · TTFT 7.258 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
234Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
975,10 tok/s TG
Prefill 7.343 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
235Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
310,19 tok/s TG
Prefill 5.706 · TTFT 484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
236Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
797,14 tok/s TG
Prefill 3.616 · TTFT 16.087 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
237Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
461,99 tok/s TG
Prefill 3.219 · TTFT 6.266 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
238gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.993,51 tok/s TG
Prefill 16.318 · TTFT 5.323 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
239gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.136,34 tok/s TG
Prefill 14.249 · TTFT 1.691 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
240gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.335,85 tok/s TG
Prefill 6.805 · TTFT 8.787 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
241gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
765,17 tok/s TG
Prefill 6.482 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
242GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
661,81 tok/s TG
Prefill 3.559 · TTFT 18.166 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
243GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
369,72 tok/s TG
Prefill 3.178 · TTFT 6.224 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
244GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 2.615 · TTFT 815 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
245Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
647,58 tok/s TG
Prefill 10.804 · TTFT 10.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
246Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
350,70 tok/s TG
Prefill 11.051 · TTFT 3.677 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
247Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,56 tok/s TG
Prefill 3.644 · TTFT 1.108 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
248command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,96 tok/s TG
Prefill 1.527 · TTFT 53.069 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
249command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,30 tok/s TG
Prefill 1.360 · TTFT 19.580 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
250command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,90 tok/s TG
Prefill 1.418 · TTFT 2.451 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M