Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
344,40 tok/s TG
Prefill 16.771 · TTFT 2.037 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
2Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,85 tok/s TG
Prefill 14.238 · TTFT 934 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
3Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
74,79 tok/s TG
Prefill 5.764 · TTFT 344 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMtensorfoldgodclaw 1.1.5NVFP4/MXFP8
4Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
584,06 tok/s TG
Prefill 25.276 · TTFT 1.075 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
5Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
358,28 tok/s TG
Prefill 20.534 · TTFT 617 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
6Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,74 tok/s TG
Prefill 9.683 · TTFT 204 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
7Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,00 tok/s TG
Prefill 470 · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
8Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,00 tok/s TG
Prefill - · TTFT 0 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAMvLLMgodclawNVFP4
9glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
10glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.057 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclaw
11Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
781,43 tok/s TG
Prefill 3.666 · TTFT 16.232 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
12Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
456,52 tok/s TG
Prefill 3.165 · TTFT 6.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
13Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
145,95 tok/s TG
Prefill 2.846 · TTFT 964 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
14glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.045 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
15glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
16glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 174 · TTFT 10.848 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
17MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,00 tok/s TG
Prefill 96 · TTFT 109.168 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
18MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,30 tok/s TG
Prefill 94 · TTFT 111.517 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
19MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,22 tok/s TG
Prefill 53 · TTFT 44.470 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
20MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,78 tok/s TG
Prefill 95 · TTFT 110.730 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
21MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,42 tok/s TG
Prefill 83 · TTFT 117.412 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
22Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,23 tok/s TG
Prefill 75 · TTFT 110.236 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
23Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,11 tok/s TG
Prefill 75 · TTFT 158.430 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
24Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,93 tok/s TG
Prefill 64 · TTFT 30.298 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
25Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,99 tok/s TG
Prefill 74 · TTFT 109.505 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
26Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,28 tok/s TG
Prefill 69 · TTFT 119.823 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
27NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,36 tok/s TG
Prefill 90 · TTFT 96.800 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
28NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,14 tok/s TG
Prefill 93 · TTFT 194.178 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
29NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,91 tok/s TG
Prefill 82 · TTFT 26.277 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
30NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,90 tok/s TG
Prefill 88 · TTFT 98.810 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
31NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,19 tok/s TG
Prefill 96 · TTFT 191.977 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
32NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,07 tok/s TG
Prefill 78 · TTFT 27.484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
33Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,96 tok/s TG
Prefill 48 · TTFT 187.060 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
34Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,93 tok/s TG
Prefill 51 · TTFT 179.975 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
35Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,29 tok/s TG
Prefill 36 · TTFT 58.861 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
36Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,10 tok/s TG
Prefill 8 · TTFT 263.746 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
37Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,94 tok/s TG
Prefill 51 · TTFT 180.358 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
38Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,28 tok/s TG
Prefill 30 · TTFT 74.267 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
39Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,09 tok/s TG
Prefill 8 · TTFT 280.190 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
40Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
835,13 tok/s TG
Prefill 3.499 · TTFT 16.577 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
41Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,82 tok/s TG
Prefill 3.019 · TTFT 6.496 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
42Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
146,11 tok/s TG
Prefill 2.580 · TTFT 1.064 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
43Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,97 tok/s TG
Prefill 45 · TTFT 191.746 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
44Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 50 · TTFT 181.487 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
45Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,63 tok/s TG
Prefill 53 · TTFT 50.822 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
46Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,09 tok/s TG
Prefill 8 · TTFT 260.023 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
47Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
791,09 tok/s TG
Prefill 3.559 · TTFT 16.497 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
48Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
470,52 tok/s TG
Prefill 3.067 · TTFT 6.420 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
49Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 48 · TTFT 182.972 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
50Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,80 tok/s TG
Prefill 49 · TTFT 183.700 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
51Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,48 tok/s TG
Prefill 7.448 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
52Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
882,70 tok/s TG
Prefill 6.523 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
53Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
292,74 tok/s TG
Prefill 5.076 · TTFT 381 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
54Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.589,11 tok/s TG
Prefill 6.805 · TTFT 8.073 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
55Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
869,89 tok/s TG
Prefill 6.141 · TTFT 2.760 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
56Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
268,04 tok/s TG
Prefill 5.498 · TTFT 360 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
57Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.560,53 tok/s TG
Prefill 10.558 · TTFT 6.806 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
58Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
824,94 tok/s TG
Prefill 9.828 · TTFT 2.187 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
59Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
217,11 tok/s TG
Prefill 6.786 · TTFT 284 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
60glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 185 · TTFT 10.186 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclaw
61minimax-m2230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,51 tok/s TG
Prefill 98 · TTFT 111.122 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
62minimax-m2230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,67 tok/s TG
Prefill 86 · TTFT 121.821 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
63minimax-m2230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,22 tok/s TG
Prefill 55 · TTFT 42.011 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
64gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.995,37 tok/s TG
Prefill 16.158 · TTFT 5.309 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
65gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.135,00 tok/s TG
Prefill 15.100 · TTFT 1.661 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
66gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
395,20 tok/s TG
Prefill 10.820 · TTFT 183 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
67gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.274,68 tok/s TG
Prefill 6.447 · TTFT 8.887 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
68gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
774,35 tok/s TG
Prefill 5.796 · TTFT 3.127 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
69gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
281,92 tok/s TG
Prefill 3.493 · TTFT 568 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
70Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
141,57 tok/s TG
Prefill 2.054 · TTFT 71.488 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
71Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,58 tok/s TG
Prefill 1.877 · TTFT 22.218 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
72Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,65 tok/s TG
Prefill 1.170 · TTFT 2.148 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
73Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
143,05 tok/s TG
Prefill 1.609 · TTFT 71.138 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
74Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
74,09 tok/s TG
Prefill 1.590 · TTFT 21.529 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
75Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,71 tok/s TG
Prefill 1.011 · TTFT 2.126 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
76NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
600,88 tok/s TG
Prefill 2.709 · TTFT 21.268 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
77NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
348,02 tok/s TG
Prefill 2.385 · TTFT 7.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
78NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
129,00 tok/s TG
Prefill 1.909 · TTFT 1.129 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
79Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
959,57 tok/s TG
Prefill 8.078 · TTFT 11.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
80Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
544,25 tok/s TG
Prefill 6.975 · TTFT 4.321 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
81Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,78 tok/s TG
Prefill 4.035 · TTFT 667 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
82Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
239,17 tok/s TG
Prefill 2.414 · TTFT 43.060 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
83Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
123,74 tok/s TG
Prefill 2.668 · TTFT 13.115 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
84Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,80 tok/s TG
Prefill 1.743 · TTFT 1.412 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
85Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
364,07 tok/s TG
Prefill 2.683 · TTFT 30.535 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
86Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
190,16 tok/s TG
Prefill 2.465 · TTFT 9.980 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
87Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,77 tok/s TG
Prefill 2.291 · TTFT 1.070 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
88Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
174,90 tok/s TG
Prefill 848 · TTFT 34.870 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
89Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,55 tok/s TG
Prefill 986 · TTFT 17.763 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
90Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,30 tok/s TG
Prefill 979 · TTFT 2.203 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
91Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
460,00 tok/s TG
Prefill 3.423 · TTFT 23.571 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
92Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
243,19 tok/s TG
Prefill 3.159 · TTFT 7.524 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
93Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,06 tok/s TG
Prefill 2.840 · TTFT 777 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
94Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.489,06 tok/s TG
Prefill 8.018 · TTFT 7.851 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
95Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
812,57 tok/s TG
Prefill 7.150 · TTFT 2.658 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
96Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
267,12 tok/s TG
Prefill 5.400 · TTFT 357 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
97Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.520,35 tok/s TG
Prefill 7.808 · TTFT 7.689 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
98Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
829,61 tok/s TG
Prefill 7.025 · TTFT 2.629 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
99Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,36 tok/s TG
Prefill 5.147 · TTFT 375 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
100Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.481,23 tok/s TG
Prefill 8.109 · TTFT 7.868 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
101Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
812,21 tok/s TG
Prefill 7.214 · TTFT 2.650 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
102Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,48 tok/s TG
Prefill 5.318 · TTFT 363 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
103Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
476,88 tok/s TG
Prefill 5.163 · TTFT 21.750 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
104Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
255,67 tok/s TG
Prefill 5.060 · TTFT 6.595 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
105Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,33 tok/s TG
Prefill 2.360 · TTFT 1.241 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
106Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
473,96 tok/s TG
Prefill 5.347 · TTFT 21.026 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
107Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,73 tok/s TG
Prefill 5.071 · TTFT 5.931 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
108Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,44 tok/s TG
Prefill 3.289 · TTFT 747 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawAWQ
109OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
480,01 tok/s TG
Prefill 5.022 · TTFT 21.777 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
110OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
255,53 tok/s TG
Prefill 5.057 · TTFT 6.588 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
111OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,35 tok/s TG
Prefill 3.427 · TTFT 714 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
112Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.639,00 tok/s TG
Prefill 13.790 · TTFT 6.893 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
113Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
905,02 tok/s TG
Prefill 13.235 · TTFT 2.202 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
114Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
303,58 tok/s TG
Prefill 8.051 · TTFT 303 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
115Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.653,28 tok/s TG
Prefill 10.581 · TTFT 7.259 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
116Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
909,92 tok/s TG
Prefill 9.716 · TTFT 2.416 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
117Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
304,38 tok/s TG
Prefill 7.815 · TTFT 312 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
118Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.689,95 tok/s TG
Prefill 14.458 · TTFT 6.609 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
119Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
938,21 tok/s TG
Prefill 13.797 · TTFT 2.113 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
120Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
311,28 tok/s TG
Prefill 8.147 · TTFT 299 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
121Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.670,49 tok/s TG
Prefill 10.926 · TTFT 7.140 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
122Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
926,17 tok/s TG
Prefill 9.914 · TTFT 2.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
123Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
312,09 tok/s TG
Prefill 8.022 · TTFT 304 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
124Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.658,09 tok/s TG
Prefill 13.451 · TTFT 6.808 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
125Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
910,76 tok/s TG
Prefill 14.150 · TTFT 2.150 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
126Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
304,63 tok/s TG
Prefill 8.163 · TTFT 298 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
127NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.773,53 tok/s TG
Prefill 8.720 · TTFT 6.861 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
128NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,80 tok/s TG
Prefill 7.787 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
129NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
356,96 tok/s TG
Prefill 5.493 · TTFT 396 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
130Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.768,14 tok/s TG
Prefill 8.360 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
131Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,26 tok/s TG
Prefill 7.851 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
132Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
356,78 tok/s TG
Prefill 4.249 · TTFT 510 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
133Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.791,48 tok/s TG
Prefill 7.972 · TTFT 6.996 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
134Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,02 tok/s TG
Prefill 7.777 · TTFT 2.448 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
135Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
357,11 tok/s TG
Prefill 2.410 · TTFT 1.169 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
136Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
546,87 tok/s TG
Prefill 3.310 · TTFT 19.828 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
137Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
288,04 tok/s TG
Prefill 3.368 · TTFT 6.271 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
138Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,42 tok/s TG
Prefill 1.538 · TTFT 1.279 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
139Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
645,14 tok/s TG
Prefill 10.717 · TTFT 14.083 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
140Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
358,30 tok/s TG
Prefill 8.069 · TTFT 4.298 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
141Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,49 tok/s TG
Prefill 6.040 · TTFT 447 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
142Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,04 tok/s TG
Prefill 10.434 · TTFT 9.706 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
143Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
569,52 tok/s TG
Prefill 9.238 · TTFT 3.017 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
144Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
147,70 tok/s TG
Prefill 3.978 · TTFT 814 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
145Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
629,49 tok/s TG
Prefill 6.861 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
146Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
350,14 tok/s TG
Prefill 6.541 · TTFT 4.589 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
147Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,15 tok/s TG
Prefill 3.697 · TTFT 735 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
148Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.008,92 tok/s TG
Prefill 9.626 · TTFT 9.750 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
149Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
571,60 tok/s TG
Prefill 9.450 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
150Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
148,00 tok/s TG
Prefill 5.910 · TTFT 383 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
151gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.104,30 tok/s TG
Prefill 5.032 · TTFT 11.207 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
152gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
588,32 tok/s TG
Prefill 4.584 · TTFT 3.743 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
153gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
151,50 tok/s TG
Prefill 4.094 · TTFT 483 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XL
154Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.532,95 tok/s TG
Prefill 17.861 · TTFT 6.225 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
155Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
876,87 tok/s TG
Prefill 11.325 · TTFT 2.242 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
156Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
239,32 tok/s TG
Prefill 11.230 · TTFT 219 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
157Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.253,31 tok/s TG
Prefill 5.076 · TTFT 10.589 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
158Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
726,51 tok/s TG
Prefill 4.456 · TTFT 4.078 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
159Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
242,22 tok/s TG
Prefill 2.455 · TTFT 1.020 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
160North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.621,00 tok/s TG
Prefill 8.046 · TTFT 7.551 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
161North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
876,14 tok/s TG
Prefill 7.415 · TTFT 2.530 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
162North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
274,43 tok/s TG
Prefill 2.836 · TTFT 699 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_M
163MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,86 tok/s TG
Prefill 73 · TTFT 138.925 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
164MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,91 tok/s TG
Prefill 71 · TTFT 147.578 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
165MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,12 tok/s TG
Prefill 50 · TTFT 45.694 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawBF16-INT4-AWQ
166MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,31 tok/s TG
Prefill 119 · TTFT 88.713 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
167MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,00 tok/s TG
Prefill 120 · TTFT 140.976 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
168MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,02 tok/s TG
Prefill 65 · TTFT 35.247 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
169Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
724,52 tok/s TG
Prefill 181 · TTFT 7.226 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
170Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
392,12 tok/s TG
Prefill 125 · TTFT 981 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
171Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,09 tok/s TG
Prefill 36 · TTFT 233 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
172Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.753,82 tok/s TG
Prefill 9.267 · TTFT 7.329 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
173Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
967,89 tok/s TG
Prefill 8.250 · TTFT 2.709 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
174Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,54 tok/s TG
Prefill 5.382 · TTFT 511 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
175Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.757,37 tok/s TG
Prefill 9.025 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
176Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
966,13 tok/s TG
Prefill 8.310 · TTFT 2.703 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
177Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,93 tok/s TG
Prefill 4.887 · TTFT 562 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
178Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.740,43 tok/s TG
Prefill 9.653 · TTFT 7.258 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
179Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
975,10 tok/s TG
Prefill 7.343 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
180Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
310,19 tok/s TG
Prefill 5.706 · TTFT 484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
181Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
797,14 tok/s TG
Prefill 3.616 · TTFT 16.087 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
182Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
461,99 tok/s TG
Prefill 3.219 · TTFT 6.266 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
183gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.993,51 tok/s TG
Prefill 16.318 · TTFT 5.323 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
184gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.136,34 tok/s TG
Prefill 14.249 · TTFT 1.691 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
185gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.335,85 tok/s TG
Prefill 6.805 · TTFT 8.787 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
186gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
765,17 tok/s TG
Prefill 6.482 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
187GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
661,81 tok/s TG
Prefill 3.559 · TTFT 18.166 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
188GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
369,72 tok/s TG
Prefill 3.178 · TTFT 6.224 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
189GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 2.615 · TTFT 815 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
190Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
647,58 tok/s TG
Prefill 10.804 · TTFT 10.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
191Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
350,70 tok/s TG
Prefill 11.051 · TTFT 3.677 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
192Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,56 tok/s TG
Prefill 3.644 · TTFT 1.108 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
193command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,96 tok/s TG
Prefill 1.527 · TTFT 53.069 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
194command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,30 tok/s TG
Prefill 1.360 · TTFT 19.580 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
195command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,90 tok/s TG
Prefill 1.418 · TTFT 2.451 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
196NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2.182,67 tok/s TG
Prefill 10.599 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
197NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.188,73 tok/s TG
Prefill 9.032 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
198NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
393,46 tok/s TG
Prefill 4.408 · TTFT 489 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
199gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.758,55 tok/s TG
Prefill 13.889 · TTFT 5.964 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
200gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
914,25 tok/s TG
Prefill 12.655 · TTFT 1.885 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
201gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
246,53 tok/s TG
Prefill 9.711 · TTFT 204 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
202gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2.414,37 tok/s TG
Prefill 20.277 · TTFT 4.107 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
203gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.349,34 tok/s TG
Prefill 18.159 · TTFT 1.302 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
204gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
378,60 tok/s TG
Prefill 10.510 · TTFT 205 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
205glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 7 · TTFT 354.674 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibriINT4
206glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 10 · TTFT 239.030 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibri
207glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 211 · TTFT 10.088 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibriINT4
208Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
952,78 tok/s TG
Prefill 20.106 · TTFT 1.542 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
209Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
596,47 tok/s TG
Prefill 26.540 · TTFT 369 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
210Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
195,04 tok/s TG
Prefill 8.425 · TTFT 231 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
211Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.028,59 tok/s TG
Prefill 24.461 · TTFT 1.670 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
212Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
594,77 tok/s TG
Prefill 25.604 · TTFT 404 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
213Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
195,53 tok/s TG
Prefill 6.810 · TTFT 291 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
214Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
500,57 tok/s TG
Prefill 5.466 · TTFT 5.230 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
215Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
298,12 tok/s TG
Prefill 5.098 · TTFT 2.468 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
216Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,17 tok/s TG
Prefill 3.527 · TTFT 696 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
217Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
510,34 tok/s TG
Prefill 6.104 · TTFT 4.473 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
218Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
300,61 tok/s TG
Prefill 4.931 · TTFT 2.537 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
219Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
71,16 tok/s TG
Prefill 2.321 · TTFT 1.217 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
220NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
533,54 tok/s TG
Prefill 16.604 · TTFT 5.626 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawBF16
221NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
397,81 tok/s TG
Prefill 11.797 · TTFT 1.550 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawBF16
222NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,04 tok/s TG
Prefill 5.708 · TTFT 732 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawBF16
223Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
910,74 tok/s TG
Prefill 33.907 · TTFT 1.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
224Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
618,22 tok/s TG
Prefill 28.790 · TTFT 435 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
225Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
228,95 tok/s TG
Prefill 9.070 · TTFT 302 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
226Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.028,53 tok/s TG
Prefill 36.884 · TTFT 916 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
227Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
666,52 tok/s TG
Prefill 27.804 · TTFT 465 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
228Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
227,91 tok/s TG
Prefill 2.384 · TTFT 1.021 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
229Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.070,56 tok/s TG
Prefill 33.741 · TTFT 976 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
230Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
676,76 tok/s TG
Prefill 21.675 · TTFT 725 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
231Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,20 tok/s TG
Prefill 8.070 · TTFT 353 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
232Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
906,04 tok/s TG
Prefill 39.029 · TTFT 1.193 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
233Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
625,71 tok/s TG
Prefill 31.724 · TTFT 396 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
234Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,88 tok/s TG
Prefill 10.557 · TTFT 236 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
235Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
961,53 tok/s TG
Prefill 32.305 · TTFT 1.633 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
236Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
649,04 tok/s TG
Prefill 17.868 · TTFT 764 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
237Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,94 tok/s TG
Prefill 4.657 · TTFT 527 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
238Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
726,94 tok/s TG
Prefill 10.204 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
239Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
411,83 tok/s TG
Prefill 7.172 · TTFT 1.728 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
240Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,03 tok/s TG
Prefill 5.629 · TTFT 380 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
241Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,25 tok/s TG
Prefill 12.250 · TTFT 2.840 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
242Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,99 tok/s TG
Prefill 8.091 · TTFT 1.621 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
243Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,99 tok/s TG
Prefill 4.687 · TTFT 495 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
244Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
725,58 tok/s TG
Prefill 11.872 · TTFT 2.430 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
245Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
423,35 tok/s TG
Prefill 6.026 · TTFT 2.001 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
246Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,87 tok/s TG
Prefill 5.696 · TTFT 375 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
247Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.015,69 tok/s TG
Prefill 20.061 · TTFT 1.289 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
248Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
615,82 tok/s TG
Prefill 13.999 · TTFT 797 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
249Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
144,83 tok/s TG
Prefill 9.895 · TTFT 217 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQ
250gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.443,88 tok/s TG
Prefill 35.348 · TTFT 560 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw