Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
Size
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,88 tok/s TG
Prefill 6.465 · TTFT 4.568 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
2Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,18 tok/s TG
Prefill 5.112 · TTFT 2.507 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
3Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,37 tok/s TG
Prefill 2.737 · TTFT 892 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
4Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,25 tok/s TG
Prefill 6.921 · TTFT 4.438 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
5Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,84 tok/s TG
Prefill 5.308 · TTFT 2.484 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
6Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,30 tok/s TG
Prefill 2.716 · TTFT 900 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
7Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
267,70 tok/s TG
Prefill 6.847 · TTFT 4.383 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
8Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,63 tok/s TG
Prefill 5.420 · TTFT 2.546 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
9Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,46 tok/s TG
Prefill 2.724 · TTFT 896 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
10North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,90 tok/s TG
Prefill 3.500 · TTFT 5.729 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
11North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,68 tok/s TG
Prefill 3.174 · TTFT 3.129 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
12North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,86 tok/s TG
Prefill 2.172 · TTFT 912 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
13Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,30 tok/s TG
Prefill 3.039 · TTFT 6.513 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
14Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
175,20 tok/s TG
Prefill 3.098 · TTFT 3.204 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
15Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
65,98 tok/s TG
Prefill 2.399 · TTFT 825 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
16Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,84 tok/s TG
Prefill 645 · TTFT 30.333 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
17Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,36 tok/s TG
Prefill 661 · TTFT 14.652 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
18Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,75 tok/s TG
Prefill 523 · TTFT 3.693 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
19Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,12 tok/s TG
Prefill 2.809 · TTFT 7.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
20Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,91 tok/s TG
Prefill 2.730 · TTFT 3.618 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
21Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
64,37 tok/s TG
Prefill 2.232 · TTFT 886 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
22Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,71 tok/s TG
Prefill 1.369 · TTFT 22.194 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
23Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,43 tok/s TG
Prefill 1.440 · TTFT 10.139 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
24Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,54 tok/s TG
Prefill 806 · TTFT 3.373 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
25Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
141,93 tok/s TG
Prefill 1.385 · TTFT 19.489 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
26Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
81,21 tok/s TG
Prefill 1.020 · TTFT 11.554 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
27Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,04 tok/s TG
Prefill 604 · TTFT 3.801 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
28Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,96 tok/s TG
Prefill 891 · TTFT 26.016 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
29Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,60 tok/s TG
Prefill 796 · TTFT 14.144 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
30Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,02 tok/s TG
Prefill 598 · TTFT 3.766 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
31Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
143,29 tok/s TG
Prefill 1.967 · TTFT 20.264 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
32Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
91,82 tok/s TG
Prefill 1.642 · TTFT 12.961 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
33Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,76 tok/s TG
Prefill 945 · TTFT 3.652 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
34Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,44 tok/s TG
Prefill 1.562 · TTFT 19.650 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
35Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,75 tok/s TG
Prefill 1.013 · TTFT 11.630 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
36Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,69 tok/s TG
Prefill 600 · TTFT 3.579 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
37Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,02 tok/s TG
Prefill 13.392 · TTFT 2.808 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
38Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
121,19 tok/s TG
Prefill 9.219 · TTFT 1.374 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
39Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
39,59 tok/s TG
Prefill 2.033 · TTFT 986 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
40Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,64 tok/s TG
Prefill 13.127 · TTFT 2.817 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
41Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,10 tok/s TG
Prefill 10.048 · TTFT 1.358 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
42Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
40,09 tok/s TG
Prefill 2.094 · TTFT 943 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
43Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 1.097 · TTFT 28.208 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
44Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,52 tok/s TG
Prefill 1.067 · TTFT 13.620 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
45Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,55 tok/s TG
Prefill 607 · TTFT 4.493 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
46Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,59 tok/s TG
Prefill 2.319 · TTFT 10.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
47Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,43 tok/s TG
Prefill 2.076 · TTFT 5.460 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
48Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
50,09 tok/s TG
Prefill 1.557 · TTFT 1.455 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
49Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
322,77 tok/s TG
Prefill 5.717 · TTFT 5.160 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
50Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
159,48 tok/s TG
Prefill 4.475 · TTFT 2.882 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
51Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
81,91 tok/s TG
Prefill 2.340 · TTFT 1.052 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
52Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,82 tok/s TG
Prefill 3.287 · TTFT 5.954 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
53Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,28 tok/s TG
Prefill 3.412 · TTFT 2.850 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
54Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,83 tok/s TG
Prefill 2.415 · TTFT 799 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
55gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,85 tok/s TG
Prefill 1.344 · TTFT 15.099 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
56gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,86 tok/s TG
Prefill 1.586 · TTFT 6.256 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
57gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,18 tok/s TG
Prefill 1.183 · TTFT 1.672 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
58Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
57,65 tok/s TG
Prefill 1.849 · TTFT 17.975 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
59Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,88 tok/s TG
Prefill 1.520 · TTFT 10.032 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
60Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,65 tok/s TG
Prefill 702 · TTFT 3.160 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
61Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
69,80 tok/s TG
Prefill 2.181 · TTFT 17.048 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
62Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
37,94 tok/s TG
Prefill 1.472 · TTFT 9.827 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
63Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,26 tok/s TG
Prefill 856 · TTFT 2.877 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
64Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
69,89 tok/s TG
Prefill 2.286 · TTFT 17.114 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
65Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
37,93 tok/s TG
Prefill 1.679 · TTFT 9.606 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
66Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,29 tok/s TG
Prefill 858 · TTFT 2.871 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
67Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,01 tok/s TG
Prefill 6.125 · TTFT 5.956 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
68Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,42 tok/s TG
Prefill 5.042 · TTFT 3.214 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
69Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
54,72 tok/s TG
Prefill 2.235 · TTFT 1.090 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
70Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
289,48 tok/s TG
Prefill 11.717 · TTFT 3.710 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
71Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,74 tok/s TG
Prefill 9.274 · TTFT 1.816 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
72Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,42 tok/s TG
Prefill 4.105 · TTFT 597 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
73Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,30 tok/s TG
Prefill 4.368 · TTFT 9.029 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
74Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,24 tok/s TG
Prefill 3.416 · TTFT 5.086 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
75Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,00 tok/s TG
Prefill 1.583 · TTFT 1.597 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
76gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,99 tok/s TG
Prefill 1.186 · TTFT 16.972 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
77gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
120,20 tok/s TG
Prefill 1.360 · TTFT 7.318 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
78gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
40,86 tok/s TG
Prefill 1.094 · TTFT 1.814 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
79gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,23 tok/s TG
Prefill 5.351 · TTFT 3.702 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
80gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,88 tok/s TG
Prefill 5.543 · TTFT 1.786 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
81gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,09 tok/s TG
Prefill 3.852 · TTFT 519 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
82Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,93 tok/s TG
Prefill 8.472 · TTFT 4.535 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
83Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
146,19 tok/s TG
Prefill 6.653 · TTFT 2.534 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
84Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,53 tok/s TG
Prefill 2.874 · TTFT 857 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
85Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,12 tok/s TG
Prefill 5.337 · TTFT 5.911 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
86Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,82 tok/s TG
Prefill 3.730 · TTFT 3.658 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
87Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
69,31 tok/s TG
Prefill 1.997 · TTFT 1.235 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
88Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,91 tok/s TG
Prefill 2.187 · TTFT 863 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
89Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
117,14 tok/s TG
Prefill 2.985 · TTFT 3.411 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
90Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
71,82 tok/s TG
Prefill 1.961 · TTFT 982 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
91Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,15 tok/s TG
Prefill 1.523 · TTFT 12.453 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
92Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
126,92 tok/s TG
Prefill 1.616 · TTFT 7.001 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
93Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
43,40 tok/s TG
Prefill 1.066 · TTFT 2.179 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
94gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,69 tok/s TG
Prefill 4.186 · TTFT 4.508 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
95gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,96 tok/s TG
Prefill 4.128 · TTFT 2.405 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
96gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
128,86 tok/s TG
Prefill 2.698 · TTFT 734 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
97Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
239,26 tok/s TG
Prefill 2.309 · TTFT 8.469 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
98Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,96 tok/s TG
Prefill 2.383 · TTFT 4.068 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
99Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,89 tok/s TG
Prefill 1.745 · TTFT 1.106 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
100gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,39 tok/s TG
Prefill 5.134 · TTFT 1.838 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
101gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
64,56 tok/s TG
Prefill 4.021 · TTFT 494 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
102Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,12 tok/s TG
Prefill 5.797 · TTFT 5.426 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
103Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
293,98 tok/s TG
Prefill 2.069 · TTFT 9.136 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
104Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,77 tok/s TG
Prefill 1.680 · TTFT 11.308 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
105North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
162,37 tok/s TG
Prefill 2.995 · TTFT 7.467 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
106Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
272,78 tok/s TG
Prefill 1.270 · TTFT 14.950 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
107Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,33 tok/s TG
Prefill 1.184 · TTFT 17.577 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
108gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
92,04 tok/s TG
Prefill 1.121 · TTFT 21.054 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
109Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
235,51 tok/s TG
Prefill 2.971 · TTFT 16.110 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
110gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,69 tok/s TG
Prefill 2.902 · TTFT 11.434 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
111Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,61 tok/s TG
Prefill 3.757 · TTFT 4.751 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
112Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,66 tok/s TG
Prefill 2.359 · TTFT 978 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
113Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,30 tok/s TG
Prefill 2.410 · TTFT 957 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
114North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,80 tok/s TG
Prefill 2.638 · TTFT 3.921 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
115North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,64 tok/s TG
Prefill 2.167 · TTFT 916 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
116Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,90 tok/s TG
Prefill 570 · TTFT 3.308 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
117Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,19 tok/s TG
Prefill 2.436 · TTFT 3.874 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
118Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,19 tok/s TG
Prefill 2.207 · TTFT 897 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
119Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,31 tok/s TG
Prefill 1.043 · TTFT 31.829 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
120Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,01 tok/s TG
Prefill 798 · TTFT 17.775 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
121Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,44 tok/s TG
Prefill 401 · TTFT 5.533 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
122Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
37,84 tok/s TG
Prefill 1.126 · TTFT 30.084 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
123Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,29 tok/s TG
Prefill 834 · TTFT 17.427 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
124Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,34 tok/s TG
Prefill 483 · TTFT 5.085 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
125gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
505,77 tok/s TG
Prefill 5.745 · TTFT 7.265 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
126gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
238,53 tok/s TG
Prefill 6.897 · TTFT 1.885 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
127gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
131,94 tok/s TG
Prefill 3.904 · TTFT 521 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
128Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,63 tok/s TG
Prefill 582 · TTFT 3.807 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
129Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,69 tok/s TG
Prefill 2.964 · TTFT 3.184 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
130Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,33 tok/s TG
Prefill 2.416 · TTFT 798 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
131gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,43 tok/s TG
Prefill 1.328 · TTFT 7.107 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
132gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,42 tok/s TG
Prefill 1.172 · TTFT 1.691 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
133Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
151,54 tok/s TG
Prefill 3.490 · TTFT 9.706 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
134Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
99,49 tok/s TG
Prefill 2.638 · TTFT 5.483 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
135Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
39,60 tok/s TG
Prefill 1.351 · TTFT 1.801 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
136gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
263,50 tok/s TG
Prefill 3.150 · TTFT 4.792 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
137gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,27 tok/s TG
Prefill 3.118 · TTFT 3.181 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
138gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
137,99 tok/s TG
Prefill 2.682 · TTFT 738 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
139Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
63,76 tok/s TG
Prefill 821 · TTFT 12.234 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
140Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,98 tok/s TG
Prefill 604 · TTFT 3.558 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
141Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,91 tok/s TG
Prefill 1.493 · TTFT 6.317 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
142Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,80 tok/s TG
Prefill 1.555 · TTFT 1.457 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
143Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,07 tok/s TG
Prefill 3.576 · TTFT 3.191 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
144Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
82,52 tok/s TG
Prefill 2.347 · TTFT 1.048 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
145Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
154,77 tok/s TG
Prefill 4.675 · TTFT 3.232 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
146Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,39 tok/s TG
Prefill 2.648 · TTFT 923 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
147Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
177,66 tok/s TG
Prefill 7.172 · TTFT 5.181 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
148Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
112,96 tok/s TG
Prefill 5.589 · TTFT 2.601 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
149Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,96 tok/s TG
Prefill 3.016 · TTFT 807 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
150Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
134,78 tok/s TG
Prefill 2.304 · TTFT 4.417 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
151Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
72,45 tok/s TG
Prefill 2.015 · TTFT 956 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
152Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,68 tok/s TG
Prefill 1.242 · TTFT 8.170 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
153Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,20 tok/s TG
Prefill 1.206 · TTFT 1.877 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
154gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
41,89 tok/s TG
Prefill 1.110 · TTFT 1.590 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
155Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
109,93 tok/s TG
Prefill 1.922 · TTFT 5.295 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
156Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
63,95 tok/s TG
Prefill 1.785 · TTFT 1.081 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
157Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,90 tok/s TG
Prefill 3.102 · TTFT 4.748 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
158Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
72,25 tok/s TG
Prefill 1.990 · TTFT 1.240 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
159Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
155,73 tok/s TG
Prefill 4.994 · TTFT 7.150 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
160Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,68 tok/s TG
Prefill 3.508 · TTFT 4.145 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
161Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,56 tok/s TG
Prefill 2.006 · TTFT 1.227 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
162gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
702,86 tok/s TG
Prefill 5.157 · TTFT 6.385 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
163gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,35 tok/s TG
Prefill 5.135 · TTFT 1.933 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
164gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
114,56 tok/s TG
Prefill 4.326 · TTFT 459 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
165Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
165,38 tok/s TG
Prefill 2.122 · TTFT 11.901 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
166Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
130,60 tok/s TG
Prefill 1.824 · TTFT 6.739 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
167Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,67 tok/s TG
Prefill 1.420 · TTFT 1.714 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
168Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
164,72 tok/s TG
Prefill 2.120 · TTFT 11.924 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
169Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
129,87 tok/s TG
Prefill 1.825 · TTFT 6.733 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
170Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,77 tok/s TG
Prefill 1.410 · TTFT 1.728 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppopenclaw_cliQ4_K_M
171Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
165,70 tok/s TG
Prefill 2.126 · TTFT 11.893 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
172Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
119,78 tok/s TG
Prefill 1.913 · TTFT 6.365 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
173Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,55 tok/s TG
Prefill 1.012 · TTFT 2.767 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
174Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,63 tok/s TG
Prefill 526 · TTFT 12.228 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
175Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,44 tok/s TG
Prefill 569 · TTFT 6.731 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
176Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,38 tok/s TG
Prefill 1.340 · TTFT 1.817 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
177Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,61 tok/s TG
Prefill 521 · TTFT 12.366 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
178Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,42 tok/s TG
Prefill 573 · TTFT 6.696 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
179Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,43 tok/s TG
Prefill 1.347 · TTFT 1.808 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
180Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,54 tok/s TG
Prefill 526 · TTFT 12.223 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
181Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,58 tok/s TG
Prefill 573 · TTFT 6.695 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
182Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,44 tok/s TG
Prefill 1.346 · TTFT 1.809 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
183Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,05 tok/s TG
Prefill 1.249 · TTFT 10.941 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
184Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,49 tok/s TG
Prefill 662 · TTFT 6.915 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
185Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,56 tok/s TG
Prefill 1.210 · TTFT 2.013 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
186Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
111,77 tok/s TG
Prefill 847 · TTFT 17.641 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
187Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
51,03 tok/s TG
Prefill 716 · TTFT 7.799 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
188Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,57 tok/s TG
Prefill 1.099 · TTFT 2.217 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
189Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
296,15 tok/s TG
Prefill 4.336 · TTFT 4.376 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
190Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,38 tok/s TG
Prefill 4.258 · TTFT 2.272 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
191Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,91 tok/s TG
Prefill 2.711 · TTFT 713 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
192Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,19 tok/s TG
Prefill 541 · TTFT 11.882 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
193Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,60 tok/s TG
Prefill 591 · TTFT 6.490 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
194Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,64 tok/s TG
Prefill 1.393 · TTFT 1.749 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
195gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
99,95 tok/s TG
Prefill 166 · TTFT 119.519 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
196gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
72,98 tok/s TG
Prefill 351 · TTFT 36.215 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
197gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
329,94 tok/s TG
Prefill 3.647 · TTFT 5.519 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
198gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,15 tok/s TG
Prefill 3.285 · TTFT 3.021 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
199gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
141,60 tok/s TG
Prefill 2.423 · TTFT 839 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
200gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,75 tok/s TG
Prefill 1.247 · TTFT 16.274 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
201gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 1.128 · TTFT 8.806 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
202gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 874 · TTFT 2.364 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
203gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,94 tok/s TG
Prefill 176 · TTFT 112.412 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
204gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
54,15 tok/s TG
Prefill 435 · TTFT 38.812 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
205gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,81 tok/s TG
Prefill 701 · TTFT 2.818 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
206Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,53 tok/s TG
Prefill 2.489 · TTFT 8.976 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
207Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
193,40 tok/s TG
Prefill 2.117 · TTFT 4.707 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
208Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,56 tok/s TG
Prefill 1.745 · TTFT 1.105 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
209Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,48 tok/s TG
Prefill 3.217 · TTFT 7.108 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
210Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,64 tok/s TG
Prefill 2.920 · TTFT 3.432 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
211Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,72 tok/s TG
Prefill 1.923 · TTFT 1.004 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
212Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
26,55 tok/s TG
Prefill 139 · TTFT 158.212 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
213Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,44 tok/s TG
Prefill 103 · TTFT 96.074 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
214Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,89 tok/s TG
Prefill 89 · TTFT 21.613 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
215Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,49 tok/s TG
Prefill 1.122 · TTFT 20.322 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
216Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,05 tok/s TG
Prefill 1.007 · TTFT 9.929 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
217Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,68 tok/s TG
Prefill 759 · TTFT 2.540 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
218gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
344,13 tok/s TG
Prefill 3.766 · TTFT 5.354 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
219gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
319,92 tok/s TG
Prefill 3.167 · TTFT 3.125 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
220gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,64 tok/s TG
Prefill 2.341 · TTFT 874 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
221Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
245,10 tok/s TG
Prefill 5.881 · TTFT 4.862 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
222Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
200,47 tok/s TG
Prefill 5.590 · TTFT 2.527 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
223Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,01 tok/s TG
Prefill 2.897 · TTFT 845 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
224Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,36 tok/s TG
Prefill 5.960 · TTFT 5.584 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
225Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,00 tok/s TG
Prefill 4.544 · TTFT 2.942 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
226Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,05 tok/s TG
Prefill 2.471 · TTFT 1.026 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
227gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,44 tok/s TG
Prefill 276 · TTFT 6.828 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
228Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,95 tok/s TG
Prefill 7.786 · TTFT 4.143 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
229Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,94 tok/s TG
Prefill 5.476 · TTFT 2.426 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
230Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,05 tok/s TG
Prefill 3.211 · TTFT 760 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
231Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
241,10 tok/s TG
Prefill 5.388 · TTFT 5.855 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
232Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,83 tok/s TG
Prefill 4.807 · TTFT 2.927 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
233Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,07 tok/s TG
Prefill 2.470 · TTFT 1.034 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
234Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
254,59 tok/s TG
Prefill 7.497 · TTFT 4.296 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
235Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
199,74 tok/s TG
Prefill 5.200 · TTFT 2.539 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
236Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,75 tok/s TG
Prefill 2.900 · TTFT 840 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
237Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
251,08 tok/s TG
Prefill 5.146 · TTFT 6.222 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
238Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
203,52 tok/s TG
Prefill 4.756 · TTFT 2.908 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
239Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,04 tok/s TG
Prefill 2.447 · TTFT 1.039 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
240Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
124,50 tok/s TG
Prefill 4.431 · TTFT 5.687 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
241Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
163,29 tok/s TG
Prefill 3.551 · TTFT 3.722 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
242Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,62 tok/s TG
Prefill 2.193 · TTFT 1.194 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
243Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
264,15 tok/s TG
Prefill 7.432 · TTFT 4.406 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
244Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,56 tok/s TG
Prefill 5.340 · TTFT 2.489 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
245Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,78 tok/s TG
Prefill 3.170 · TTFT 771 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
246Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,28 tok/s TG
Prefill 2.468 · TTFT 9.078 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
247Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,57 tok/s TG
Prefill 2.108 · TTFT 4.741 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
248Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,39 tok/s TG
Prefill 1.780 · TTFT 1.084 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
249Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,82 tok/s TG
Prefill 1.287 · TTFT 23.009 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
250Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,79 tok/s TG
Prefill 1.252 · TTFT 11.277 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0