Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,08 tok/s TG
Prefill 1.548 · TTFT 12.948 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
2gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,67 tok/s TG
Prefill 1.446 · TTFT 6.855 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
3gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,23 tok/s TG
Prefill 1.354 · TTFT 1.459 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
4NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
136,58 tok/s TG
Prefill 2.934 · TTFT 8.734 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
5NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
116,18 tok/s TG
Prefill 2.075 · TTFT 5.320 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
6NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
81,10 tok/s TG
Prefill 1.729 · TTFT 1.247 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
7Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
169,42 tok/s TG
Prefill 2.873 · TTFT 7.817 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
8Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,96 tok/s TG
Prefill 2.158 · TTFT 4.629 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
9Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
76,77 tok/s TG
Prefill 1.830 · TTFT 1.055 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
10Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
161,05 tok/s TG
Prefill 5.256 · TTFT 6.170 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
11Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
129,46 tok/s TG
Prefill 3.442 · TTFT 3.808 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
12Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
81,15 tok/s TG
Prefill 2.472 · TTFT 986 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
13gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,28 tok/s TG
Prefill 4.282 · TTFT 4.702 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
14gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,02 tok/s TG
Prefill 3.859 · TTFT 2.570 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
15gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,78 tok/s TG
Prefill 3.326 · TTFT 594 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
16NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,84 tok/s TG
Prefill 3.760 · TTFT 5.878 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
17NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
54,14 tok/s TG
Prefill 3.027 · TTFT 3.561 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
18NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,44 tok/s TG
Prefill 1.717 · TTFT 1.294 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
19Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
420,20 tok/s TG
Prefill 656 · TTFT 131.641 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
20Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,19 tok/s TG
Prefill 592 · TTFT 60.940 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
21Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
41,83 tok/s TG
Prefill 301 · TTFT 8.495 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
22Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,87 tok/s TG
Prefill 1.120 · TTFT 20.453 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
23Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
66,02 tok/s TG
Prefill 838 · TTFT 12.155 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
24Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
36,38 tok/s TG
Prefill 714 · TTFT 2.760 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
25Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,39 tok/s TG
Prefill 3.269 · TTFT 6.004 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
26Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,45 tok/s TG
Prefill 2.547 · TTFT 3.826 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
27Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,26 tok/s TG
Prefill 1.798 · TTFT 1.074 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
28Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
492,83 tok/s TG
Prefill 1.231 · TTFT 103.873 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
29Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
246,45 tok/s TG
Prefill 1.171 · TTFT 47.068 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
30Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,88 tok/s TG
Prefill 909 · TTFT 2.194 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
31Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
167,11 tok/s TG
Prefill 2.814 · TTFT 6.937 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
32Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,61 tok/s TG
Prefill 2.590 · TTFT 3.731 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
33Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,40 tok/s TG
Prefill 2.292 · TTFT 842 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
34Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
182,87 tok/s TG
Prefill 7.295 · TTFT 5.014 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
35Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
146,91 tok/s TG
Prefill 4.736 · TTFT 2.900 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
36Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
86,23 tok/s TG
Prefill 2.963 · TTFT 824 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
37Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
169,89 tok/s TG
Prefill 7.470 · TTFT 5.007 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
38Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
139,24 tok/s TG
Prefill 5.091 · TTFT 2.946 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
39Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,18 tok/s TG
Prefill 2.987 · TTFT 816 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
40gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
202,12 tok/s TG
Prefill 4.412 · TTFT 4.498 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliMXFP4
41gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
148,88 tok/s TG
Prefill 4.312 · TTFT 2.296 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliMXFP4
42gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,16 tok/s TG
Prefill 3.589 · TTFT 550 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliMXFP4
43Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,67 tok/s TG
Prefill 1.397 · TTFT 48.511 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
44Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
142,76 tok/s TG
Prefill 1.244 · TTFT 17.133 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
45Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,48 tok/s TG
Prefill 1.201 · TTFT 2.031 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
46Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,66 tok/s TG
Prefill 1.396 · TTFT 48.986 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
47Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
140,35 tok/s TG
Prefill 1.237 · TTFT 17.315 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
48Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,20 tok/s TG
Prefill 1.176 · TTFT 2.071 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
49Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,76 tok/s TG
Prefill 1.399 · TTFT 49.349 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
50Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
139,82 tok/s TG
Prefill 1.244 · TTFT 17.279 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
51Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,36 tok/s TG
Prefill 3.237 · TTFT 6.850 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0
52Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,44 tok/s TG
Prefill 1.189 · TTFT 2.051 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
53Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,61 tok/s TG
Prefill 2.849 · TTFT 3.806 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0
54Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,04 tok/s TG
Prefill 2.341 · TTFT 935 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0
55Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
148,79 tok/s TG
Prefill 3.362 · TTFT 6.588 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
56Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
123,54 tok/s TG
Prefill 2.897 · TTFT 3.743 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
57Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
76,95 tok/s TG
Prefill 2.356 · TTFT 929 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
58Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,98 tok/s TG
Prefill 1.446 · TTFT 66.475 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
59Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,05 tok/s TG
Prefill 1.600 · TTFT 43.239 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
60Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,50 tok/s TG
Prefill 1.156 · TTFT 10.550 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
61Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,10 tok/s TG
Prefill 1.157 · TTFT 10.523 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
62Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,27 tok/s TG
Prefill 1.151 · TTFT 2.118 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
63Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,12 tok/s TG
Prefill 1.171 · TTFT 2.084 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_M
64Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
38,54 tok/s TG
Prefill 2.124 · TTFT 1.146 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawFP8
65Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,91 tok/s TG
Prefill 3.713 · TTFT 537 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawFP8
66NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,39 tok/s TG
Prefill 1.495 · TTFT 1.449 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
67glm-4.7-flash31.2BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,92 tok/s TG
Prefill 4.055 · TTFT 536 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
68Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,79 tok/s TG
Prefill 3.315 · TTFT 589 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawFP8
69NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
58,25 tok/s TG
Prefill 5.466 · TTFT 395 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
70Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,06 tok/s TG
Prefill 4.378 · TTFT 451 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
71Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,59 tok/s TG
Prefill 6.798 · TTFT 285 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
72Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
92,96 tok/s TG
Prefill 4.802 · TTFT 404 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
73Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
74,19 tok/s TG
Prefill 4.923 · TTFT 393 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
74Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,18 tok/s TG
Prefill 6.144 · TTFT 314 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
75NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
367,75 tok/s TG
Prefill 3.397 · TTFT 29.121 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
76NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
210,25 tok/s TG
Prefill 3.483 · TTFT 8.798 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
77NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
76,87 tok/s TG
Prefill 2.223 · TTFT 1.006 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
78gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
488,18 tok/s TG
Prefill 4.229 · TTFT 20.915 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
79gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
251,39 tok/s TG
Prefill 3.708 · TTFT 6.599 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
80gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
63,50 tok/s TG
Prefill 2.576 · TTFT 769 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
81NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
354,29 tok/s TG
Prefill 3.544 · TTFT 30.045 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
82NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
202,30 tok/s TG
Prefill 3.149 · TTFT 9.380 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
83NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
72,70 tok/s TG
Prefill 1.798 · TTFT 1.470 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
84gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
455,06 tok/s TG
Prefill 3.954 · TTFT 21.269 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
85gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
245,62 tok/s TG
Prefill 3.740 · TTFT 6.690 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
86gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,50 tok/s TG
Prefill 1.862 · TTFT 1.599 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
87gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
903,30 tok/s TG
Prefill 6.960 · TTFT 11.382 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
88gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
461,54 tok/s TG
Prefill 5.838 · TTFT 3.795 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
89gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
484,77 tok/s TG
Prefill 4.124 · TTFT 21.088 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
90gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
246,68 tok/s TG
Prefill 3.165 · TTFT 7.126 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
91gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
860,88 tok/s TG
Prefill 6.641 · TTFT 11.413 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
92gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
478,55 tok/s TG
Prefill 6.243 · TTFT 3.601 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
93MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,49 tok/s TG
Prefill 7.016 · TTFT 5.294 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
94MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
77,74 tok/s TG
Prefill 5.460 · TTFT 2.641 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
95MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,23 tok/s TG
Prefill 2.184 · TTFT 1.050 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
96MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,63 tok/s TG
Prefill 4.568 · TTFT 13.673 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
97MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,35 tok/s TG
Prefill 1.986 · TTFT 1.157 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
98MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,25 tok/s TG
Prefill 6.620 · TTFT 5.066 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
99MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
66,75 tok/s TG
Prefill 6.946 · TTFT 4.901 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
100MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
64,45 tok/s TG
Prefill 7.167 · TTFT 4.743 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
101MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
52,46 tok/s TG
Prefill 5.268 · TTFT 2.720 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
102MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
51,61 tok/s TG
Prefill 5.448 · TTFT 2.676 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
103MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,25 tok/s TG
Prefill 2.437 · TTFT 960 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
104MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,01 tok/s TG
Prefill 2.068 · TTFT 1.108 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
105minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
105,57 tok/s TG
Prefill 6.997 · TTFT 5.319 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
106minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,44 tok/s TG
Prefill 5.550 · TTFT 2.628 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
107minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,93 tok/s TG
Prefill 2.096 · TTFT 1.093 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
108MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
174,20 tok/s TG
Prefill 5.042 · TTFT 47.620 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
109MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,12 tok/s TG
Prefill 5.634 · TTFT 12.854 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
110MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,52 tok/s TG
Prefill 2.328 · TTFT 991 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
111MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkPerformancetest Small 1.0
34,37 tok/s TG
Prefill 503 · TTFT 105 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
112MiniMax-M2.7-AWQ-4bit230BMiniMax Harness benchmarkTool-Parcours Dossier 40 V1.0
3.641 Pkt
61,1% · 40/40 Aufg. · 8.209,0 s
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQ
113MiniMax-M2.7230BMiniMax Harness benchmarkTool Usage Standard 1.0
858 Pkt
28,8% · 16/16 Aufg. · 1.222,0 s
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMgodclawAWQ-4BIT
114MiniMax-M2.5230BMiniMax Harness benchmarkTool Usage Standard 1.0
1.762 Pkt
59,1% · 16/16 Aufg. · 526,0 s
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMopenclaw_cliBF16-INT4-AWQ
115MiniMax-M2.5230BMiniMax Harness benchmarkTextgenerierung V 1.0
790 Pkt
52,0% · 15/15 Aufg. · 261,0 s
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMopenclaw_cliBF16-INT4-AWQ
116MiniMax-M2.5230BMiniMax Harness benchmarkTool Usage V 1.0
1.245 Pkt
70,7% · 15/15 Aufg. · 301,0 s
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMopenclaw_cliBF16-INT4-AWQ