Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,51 tok/s TG
Prefill 4.348 · TTFT 4.623 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
2gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
176,12 tok/s TG
Prefill 3.846 · TTFT 2.574 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
3gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
65,22 tok/s TG
Prefill 3.462 · TTFT 571 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
4gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
427,76 tok/s TG
Prefill 8.456 · TTFT 2.403 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
5gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
273,22 tok/s TG
Prefill 7.074 · TTFT 1.399 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
6gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,62 tok/s TG
Prefill 5.798 · TTFT 343 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
7NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
283,50 tok/s TG
Prefill 4.190 · TTFT 6.068 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
8NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
213,81 tok/s TG
Prefill 3.032 · TTFT 3.678 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
9NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,45 tok/s TG
Prefill 2.607 · TTFT 827 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
10NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
294,37 tok/s TG
Prefill 4.193 · TTFT 6.057 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
11NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,49 tok/s TG
Prefill 2.912 · TTFT 3.858 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
12NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
110,73 tok/s TG
Prefill 2.564 · TTFT 841 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
13Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
295,16 tok/s TG
Prefill 4.265 · TTFT 6.027 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
14Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,61 tok/s TG
Prefill 2.963 · TTFT 3.827 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
15Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,56 tok/s TG
Prefill 2.551 · TTFT 851 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
16Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,46 tok/s TG
Prefill 3.907 · TTFT 5.778 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
17Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
166,21 tok/s TG
Prefill 2.966 · TTFT 3.382 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
18Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,10 tok/s TG
Prefill 2.330 · TTFT 828 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
19Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,76 tok/s TG
Prefill 3.994 · TTFT 5.630 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
20Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,65 tok/s TG
Prefill 3.083 · TTFT 3.258 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
21Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,71 tok/s TG
Prefill 2.390 · TTFT 807 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
22Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,14 tok/s TG
Prefill 4.085 · TTFT 5.519 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
23Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,95 tok/s TG
Prefill 3.108 · TTFT 3.229 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
24Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,58 tok/s TG
Prefill 2.478 · TTFT 778 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
25Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,40 tok/s TG
Prefill 7.121 · TTFT 4.462 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
26Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
188,69 tok/s TG
Prefill 4.792 · TTFT 2.726 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
27Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
94,91 tok/s TG
Prefill 3.258 · TTFT 750 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
28Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,22 tok/s TG
Prefill 6.992 · TTFT 4.523 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
29Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,78 tok/s TG
Prefill 4.641 · TTFT 2.817 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
30Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,11 tok/s TG
Prefill 3.281 · TTFT 744 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
31Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,18 tok/s TG
Prefill 7.760 · TTFT 4.096 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
32Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
199,14 tok/s TG
Prefill 5.601 · TTFT 2.464 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
33Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,90 tok/s TG
Prefill 3.563 · TTFT 686 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
34Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,79 tok/s TG
Prefill 5.303 · TTFT 5.204 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
35Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
193,52 tok/s TG
Prefill 3.923 · TTFT 3.136 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
36Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,77 tok/s TG
Prefill 3.358 · TTFT 726 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
37Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,26 tok/s TG
Prefill 1.865 · TTFT 16.524 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
38Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,62 tok/s TG
Prefill 1.539 · TTFT 9.403 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
39Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,61 tok/s TG
Prefill 911 · TTFT 2.703 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
40Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
288,80 tok/s TG
Prefill 4.736 · TTFT 6.808 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
41Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
193,11 tok/s TG
Prefill 3.767 · TTFT 3.939 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
42Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,04 tok/s TG
Prefill 3.064 · TTFT 897 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
43OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,53 tok/s TG
Prefill 1.848 · TTFT 16.560 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
44OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,60 tok/s TG
Prefill 1.544 · TTFT 9.340 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
45OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,60 tok/s TG
Prefill 916 · TTFT 2.675 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
46North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
275,30 tok/s TG
Prefill 4.383 · TTFT 5.205 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
47North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
182,28 tok/s TG
Prefill 3.436 · TTFT 3.015 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
48North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,96 tok/s TG
Prefill 3.088 · TTFT 641 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
49Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,83 tok/s TG
Prefill 1.188 · TTFT 16.950 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
50Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,58 tok/s TG
Prefill 1.050 · TTFT 9.383 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
51Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,32 tok/s TG
Prefill 999 · TTFT 1.966 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
52Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
117,36 tok/s TG
Prefill 1.455 · TTFT 15.755 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
53Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,07 tok/s TG
Prefill 985 · TTFT 10.349 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
54Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
26,39 tok/s TG
Prefill 886 · TTFT 2.232 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
55Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
141,77 tok/s TG
Prefill 3.307 · TTFT 10.899 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
56Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
87,68 tok/s TG
Prefill 2.867 · TTFT 6.226 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
57Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,37 tok/s TG
Prefill 1.631 · TTFT 1.662 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
58Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
135,40 tok/s TG
Prefill 2.502 · TTFT 11.327 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
59Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,60 tok/s TG
Prefill 1.791 · TTFT 6.870 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
60Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,61 tok/s TG
Prefill 1.301 · TTFT 1.735 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
61Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,30 tok/s TG
Prefill 1.554 · TTFT 19.578 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
62Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,57 tok/s TG
Prefill 2.319 · TTFT 7.067 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
63Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,45 tok/s TG
Prefill 1.304 · TTFT 2.089 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
64Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
193,37 tok/s TG
Prefill 4.316 · TTFT 6.560 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
65Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,88 tok/s TG
Prefill 3.109 · TTFT 3.967 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
66Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,43 tok/s TG
Prefill 2.188 · TTFT 1.034 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
67gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
188,76 tok/s TG
Prefill 629 · TTFT 31.617 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
68gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,83 tok/s TG
Prefill 1.430 · TTFT 6.923 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
69gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,69 tok/s TG
Prefill 1.580 · TTFT 1.250 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
70Ornith-1.5-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
196,95 tok/s TG
Prefill 4.698 · TTFT 4.796 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
71Ornith-1.5-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
139,16 tok/s TG
Prefill 3.596 · TTFT 2.796 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
72Ornith-1.5-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,42 tok/s TG
Prefill 2.788 · TTFT 691 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
73Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,77 tok/s TG
Prefill 9.631 · TTFT 3.487 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
74Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
151,97 tok/s TG
Prefill 7.125 · TTFT 2.029 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
75Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
55,43 tok/s TG
Prefill 4.133 · TTFT 598 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
76Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,57 tok/s TG
Prefill 9.085 · TTFT 3.442 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
77Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,09 tok/s TG
Prefill 6.490 · TTFT 2.083 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
78Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
58,79 tok/s TG
Prefill 4.166 · TTFT 593 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
79NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
344,85 tok/s TG
Prefill 4.759 · TTFT 5.325 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
80NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,85 tok/s TG
Prefill 2.967 · TTFT 3.756 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
81NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,85 tok/s TG
Prefill 2.620 · TTFT 821 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
82Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,24 tok/s TG
Prefill 9.520 · TTFT 2.933 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
83Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
212,67 tok/s TG
Prefill 6.514 · TTFT 1.882 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
84Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
85,07 tok/s TG
Prefill 5.545 · TTFT 440 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
85Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
364,13 tok/s TG
Prefill 15.658 · TTFT 1.918 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
86Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
289,42 tok/s TG
Prefill 10.849 · TTFT 1.212 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
87Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
93,07 tok/s TG
Prefill 7.599 · TTFT 324 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
88Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
397,16 tok/s TG
Prefill 14.911 · TTFT 2.001 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
89Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
261,48 tok/s TG
Prefill 13.512 · TTFT 1.061 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
90Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,38 tok/s TG
Prefill 7.256 · TTFT 344 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
91Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
492,68 tok/s TG
Prefill 18.535 · TTFT 1.471 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
92Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
320,89 tok/s TG
Prefill 13.760 · TTFT 902 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
93Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,39 tok/s TG
Prefill 9.842 · TTFT 248 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
94Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
561,43 tok/s TG
Prefill 27.407 · TTFT 973 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
95Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
449,35 tok/s TG
Prefill 21.718 · TTFT 571 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
96Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
227,38 tok/s TG
Prefill 13.749 · TTFT 177 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
97Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,65 tok/s TG
Prefill 1.214 · TTFT 20.637 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
98Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,44 tok/s TG
Prefill 896 · TTFT 12.716 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
99Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,89 tok/s TG
Prefill 787 · TTFT 2.807 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
100Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
114,99 tok/s TG
Prefill 1.982 · TTFT 16.358 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
101Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,29 tok/s TG
Prefill 1.532 · TTFT 9.444 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
102Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,51 tok/s TG
Prefill 888 · TTFT 2.770 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
103Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,74 tok/s TG
Prefill 1.377 · TTFT 16.495 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
104Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,57 tok/s TG
Prefill 1.027 · TTFT 9.755 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
105Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
26,14 tok/s TG
Prefill 871 · TTFT 2.219 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
106Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
142,79 tok/s TG
Prefill 4.374 · TTFT 10.633 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
107Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
87,06 tok/s TG
Prefill 3.482 · TTFT 6.548 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
108Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,37 tok/s TG
Prefill 2.019 · TTFT 1.676 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
109Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,08 tok/s TG
Prefill 3.434 · TTFT 9.975 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
110Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,06 tok/s TG
Prefill 2.578 · TTFT 5.626 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
111Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,50 tok/s TG
Prefill 1.317 · TTFT 1.755 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
112Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
240,22 tok/s TG
Prefill 7.577 · TTFT 4.168 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
113Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
192,64 tok/s TG
Prefill 5.318 · TTFT 2.482 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
114Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,64 tok/s TG
Prefill 3.403 · TTFT 719 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
115gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
323,59 tok/s TG
Prefill 5.090 · TTFT 3.955 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliMXFP4
116gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,43 tok/s TG
Prefill 4.599 · TTFT 2.157 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliMXFP4
117gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
120,65 tok/s TG
Prefill 3.944 · TTFT 501 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliMXFP4
118Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,77 tok/s TG
Prefill 4.023 · TTFT 5.609 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
119Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,14 tok/s TG
Prefill 3.065 · TTFT 3.273 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
120Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,77 tok/s TG
Prefill 2.423 · TTFT 797 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
121Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,87 tok/s TG
Prefill 1.620 · TTFT 1.505 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
122Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,57 tok/s TG
Prefill 2.376 · TTFT 10.673 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
123Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
131,42 tok/s TG
Prefill 2.111 · TTFT 5.856 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
124Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,00 tok/s TG
Prefill 1.596 · TTFT 1.528 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
125Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
160,21 tok/s TG
Prefill 2.383 · TTFT 10.663 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
126Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,29 tok/s TG
Prefill 2.467 · TTFT 4.937 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
127Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,23 tok/s TG
Prefill 1.307 · TTFT 2.018 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
128Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,72 tok/s TG
Prefill 575 · TTFT 11.195 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
129Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,40 tok/s TG
Prefill 643 · TTFT 5.943 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
130Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,38 tok/s TG
Prefill 1.552 · TTFT 1.571 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
131Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,19 tok/s TG
Prefill 1.532 · TTFT 9.080 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
132Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,38 tok/s TG
Prefill 799 · TTFT 5.842 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
133Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,42 tok/s TG
Prefill 1.411 · TTFT 1.727 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
134Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
117,63 tok/s TG
Prefill 1.021 · TTFT 14.961 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
135Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,46 tok/s TG
Prefill 914 · TTFT 6.116 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
136Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,31 tok/s TG
Prefill 1.439 · TTFT 1.692 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
137Qwen2.5-32B-Instruct32.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,29 tok/s TG
Prefill 857 · TTFT 2.683 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
138NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,26 tok/s TG
Prefill 1.009 · TTFT 2.135 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
139Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,80 tok/s TG
Prefill 563 · TTFT 11.301 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
140Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,78 tok/s TG
Prefill 603 · TTFT 6.318 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
141Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,87 tok/s TG
Prefill 1.400 · TTFT 1.739 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
142Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
75,28 tok/s TG
Prefill 2.774 · TTFT 8.886 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
143Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,70 tok/s TG
Prefill 2.092 · TTFT 5.044 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
144Muse-Glimmer-30B29.8Bmeta-models PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,16 tok/s TG
Prefill 1.213 · TTFT 1.622 ms
1×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
145Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
141,11 tok/s TG
Prefill 1.831 · TTFT 16.128 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
146Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,79 tok/s TG
Prefill 1.311 · TTFT 9.807 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
147Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,35 tok/s TG
Prefill 1.608 · TTFT 8.030 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
148Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,64 tok/s TG
Prefill 1.302 · TTFT 1.869 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
149Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,57 tok/s TG
Prefill 13.855 · TTFT 2.538 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawGPTQ
150Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,64 tok/s TG
Prefill 10.369 · TTFT 1.153 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawGPTQ
151Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,07 tok/s TG
Prefill 3.539 · TTFT 554 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawGPTQ
152Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
146,44 tok/s TG
Prefill 6.889 · TTFT 4.782 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
153Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
81,20 tok/s TG
Prefill 5.042 · TTFT 2.489 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
154Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,88 tok/s TG
Prefill 2.107 · TTFT 942 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
155Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,23 tok/s TG
Prefill 1.539 · TTFT 19.009 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
156Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,86 tok/s TG
Prefill 1.187 · TTFT 10.510 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
157Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,94 tok/s TG
Prefill 674 · TTFT 2.981 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
158Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,34 tok/s TG
Prefill 3.766 · TTFT 8.416 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
159Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
56,56 tok/s TG
Prefill 2.767 · TTFT 4.639 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
160Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,24 tok/s TG
Prefill 1.305 · TTFT 1.538 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ-INT4
161Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
162,00 tok/s TG
Prefill 10.559 · TTFT 3.102 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
162Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,13 tok/s TG
Prefill 8.084 · TTFT 1.530 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
163Qwen3.8-27B27.8BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,95 tok/s TG
Prefill 3.079 · TTFT 642 ms
1×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
164NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
290,27 tok/s TG
Prefill 35.719 · TTFT 1.015 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
165NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
170,48 tok/s TG
Prefill 23.477 · TTFT 582 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
166NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
53,38 tok/s TG
Prefill 6.812 · TTFT 427 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16
167Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,25 tok/s TG
Prefill 1.621 · TTFT 14.654 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
168Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,68 tok/s TG
Prefill 1.664 · TTFT 6.787 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
169Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,57 tok/s TG
Prefill 1.323 · TTFT 1.665 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
170Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,98 tok/s TG
Prefill 4.071 · TTFT 5.658 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
171Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
185,39 tok/s TG
Prefill 3.957 · TTFT 2.535 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
172Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,90 tok/s TG
Prefill 2.545 · TTFT 758 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
173Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
220,45 tok/s TG
Prefill 4.107 · TTFT 5.581 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
174Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,99 tok/s TG
Prefill 3.958 · TTFT 2.533 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
175Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,07 tok/s TG
Prefill 2.705 · TTFT 712 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
176Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
188,35 tok/s TG
Prefill 4.100 · TTFT 5.611 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
177Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,45 tok/s TG
Prefill 4.012 · TTFT 2.498 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
178Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,89 tok/s TG
Prefill 2.715 · TTFT 711 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
179DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,48 tok/s TG
Prefill 207 · TTFT 124.898 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
180DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,60 tok/s TG
Prefill 168 · TTFT 72.538 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
181DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,52 tok/s TG
Prefill 132 · TTFT 17.401 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
182Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,93 tok/s TG
Prefill 619 · TTFT 39.268 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
183Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,44 tok/s TG
Prefill 894 · TTFT 14.722 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
184Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,94 tok/s TG
Prefill 438 · TTFT 4.915 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
185Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,85 tok/s TG
Prefill 3.842 · TTFT 5.955 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
186Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,28 tok/s TG
Prefill 3.620 · TTFT 2.799 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
187Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,58 tok/s TG
Prefill 2.449 · TTFT 787 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
188Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,09 tok/s TG
Prefill 148 · TTFT 146.240 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
189Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,04 tok/s TG
Prefill 233 · TTFT 54.589 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
190Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,47 tok/s TG
Prefill 394 · TTFT 5.441 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
191NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,17 tok/s TG
Prefill 851 · TTFT 2.528 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
192NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
212,92 tok/s TG
Prefill 3.795 · TTFT 6.753 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
193NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
207,55 tok/s TG
Prefill 3.338 · TTFT 3.388 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
194NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,88 tok/s TG
Prefill 2.728 · TTFT 789 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
195Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
93,75 tok/s TG
Prefill 2.324 · TTFT 9.824 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
196Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,07 tok/s TG
Prefill 1.552 · TTFT 6.518 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
197Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,52 tok/s TG
Prefill 1.209 · TTFT 1.623 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
198Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
222,82 tok/s TG
Prefill 4.205 · TTFT 4.901 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
199Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
186,28 tok/s TG
Prefill 3.569 · TTFT 2.478 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
200Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,94 tok/s TG
Prefill 684 · TTFT 2.516 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
201Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 3.928 · TTFT 5.087 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
202Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,74 tok/s TG
Prefill 3.527 · TTFT 2.492 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
203Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,31 tok/s TG
Prefill 2.487 · TTFT 692 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
204Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,97 tok/s TG
Prefill 3.848 · TTFT 5.198 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
205Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
192,04 tok/s TG
Prefill 3.084 · TTFT 2.806 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
206Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,13 tok/s TG
Prefill 1.289 · TTFT 1.337 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_M
207DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,90 tok/s TG
Prefill 215 · TTFT 113.000 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
208DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,91 tok/s TG
Prefill 161 · TTFT 66.087 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
209DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,56 tok/s TG
Prefill 116 · TTFT 17.650 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
210DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,92 tok/s TG
Prefill 218 · TTFT 111.123 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
211DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 162 · TTFT 65.453 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
212DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,01 tok/s TG
Prefill 118 · TTFT 17.314 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
213DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,26 tok/s TG
Prefill 218 · TTFT 111.171 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
214DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,05 tok/s TG
Prefill 165 · TTFT 64.548 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
215DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,81 tok/s TG
Prefill 119 · TTFT 17.125 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
216DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,48 tok/s TG
Prefill 220 · TTFT 110.219 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
217DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,86 tok/s TG
Prefill 166 · TTFT 63.926 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
218DeepSeek-V4-Flash290.9BDeepSeek PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,65 tok/s TG
Prefill 120 · TTFT 16.976 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
219Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,41 tok/s TG
Prefill 1.310 · TTFT 23.793 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
220Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,21 tok/s TG
Prefill 1.051 · TTFT 12.339 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
221Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,03 tok/s TG
Prefill 480 · TTFT 3.968 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
222Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,49 tok/s TG
Prefill 1.290 · TTFT 23.886 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
223Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,68 tok/s TG
Prefill 1.025 · TTFT 12.644 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
224Devstral-2-123B-Instruct-2512123BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,83 tok/s TG
Prefill 476 · TTFT 4.001 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
225Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,36 tok/s TG
Prefill 3.683 · TTFT 5.472 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
226Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
173,97 tok/s TG
Prefill 3.522 · TTFT 2.513 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
227Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,57 tok/s TG
Prefill 2.415 · TTFT 713 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
228Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,42 tok/s TG
Prefill 178 · TTFT 109.132 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
229Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,58 tok/s TG
Prefill 284 · TTFT 34.055 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
230Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,57 tok/s TG
Prefill 383 · TTFT 5.006 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
231Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,96 tok/s TG
Prefill 401 · TTFT 4.771 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
232Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,49 tok/s TG
Prefill 163 · TTFT 118.721 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
233Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,85 tok/s TG
Prefill 298 · TTFT 32.384 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
234Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,57 tok/s TG
Prefill 412 · TTFT 4.643 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
235NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,86 tok/s TG
Prefill 805 · TTFT 2.387 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
236NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,17 tok/s TG
Prefill 211 · TTFT 47.089 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
237NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
14,79 tok/s TG
Prefill 187 · TTFT 10.300 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
238NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,01 tok/s TG
Prefill 3.865 · TTFT 5.849 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
239NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,06 tok/s TG
Prefill 2.824 · TTFT 3.499 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
240NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,46 tok/s TG
Prefill 2.518 · TTFT 762 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
241NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
167,21 tok/s TG
Prefill 3.497 · TTFT 6.460 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
242NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
192,66 tok/s TG
Prefill 2.706 · TTFT 3.642 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
243NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
103,21 tok/s TG
Prefill 2.393 · TTFT 803 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
244NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
154,95 tok/s TG
Prefill 3.643 · TTFT 6.292 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
245NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
192,16 tok/s TG
Prefill 2.755 · TTFT 3.564 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
246NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,92 tok/s TG
Prefill 2.124 · TTFT 903 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
247NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
178,15 tok/s TG
Prefill 3.106 · TTFT 7.058 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
248NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,41 tok/s TG
Prefill 2.159 · TTFT 4.552 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
249NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,69 tok/s TG
Prefill 1.771 · TTFT 1.085 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
250Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
98,95 tok/s TG
Prefill 2.674 · TTFT 916 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M