Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,38 tok/s TG
Prefill 14.373 · TTFT 1.721 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
2Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
417,52 tok/s TG
Prefill 12.747 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
3Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 8.225 · TTFT 296 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
4NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.562,27 tok/s TG
Prefill 2.593 · TTFT 34.854 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
5NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
795,03 tok/s TG
Prefill 2.378 · TTFT 15.951 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
6NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,32 tok/s TG
Prefill 1.225 · TTFT 2.121 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
7Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.555,31 tok/s TG
Prefill 2.655 · TTFT 34.751 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
8Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
804,23 tok/s TG
Prefill 2.435 · TTFT 15.796 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
9Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,58 tok/s TG
Prefill 1.951 · TTFT 1.010 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
10Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.564,61 tok/s TG
Prefill 2.600 · TTFT 34.894 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
11Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
783,55 tok/s TG
Prefill 2.459 · TTFT 15.907 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
12Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,06 tok/s TG
Prefill 1.772 · TTFT 1.128 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
13Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
1.044,38 tok/s TG
Prefill 38.866 · TTFT 388 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
14Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
589,64 tok/s TG
Prefill 43.711 · TTFT 223 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
15Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
133,13 tok/s TG
Prefill 20.590 · TTFT 106 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
16Kolibri-178.1BAleph Alpha HarnessbenchmarkOffice Agentic Work 100 - Tool Usage V1
100 Pkt
100,0% · 100/100 Aufg. · 547,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMofficeagentic100NVFP4
17Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
833,03 tok/s TG
Prefill - · TTFT 213 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
18Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
490,51 tok/s TG
Prefill - · TTFT 177 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
19Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,86 tok/s TG
Prefill - · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0NVFP4
20Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
283 Pkt
91,3% · 283/310 Aufg. · 2.384,4 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
21Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
119 Pkt
38,4% · 119/310 Aufg. · 87,9 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0NVFP4
22Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,92 tok/s TG
Prefill - · TTFT 227 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
23Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,30 tok/s TG
Prefill - · TTFT 165 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
24Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,47 tok/s TG
Prefill - · TTFT 98 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0FP8
25Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
289 Pkt
93,2% · 289/310 Aufg. · 2.504,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
26Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
115 Pkt
37,1% · 115/310 Aufg. · 99,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310 0.29.0FP8
27Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
846,62 tok/s TG
Prefill - · TTFT 238 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
28Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
569,97 tok/s TG
Prefill - · TTFT 160 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
29Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,71 tok/s TG
Prefill - · TTFT 160 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw 0.29.0
30Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
207 Pkt
98,6% · 207/210 Aufg. · 1.080,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
31Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
108 Pkt
51,4% · 108/210 Aufg. · 72,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210 0.29.0FP8
32Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 57,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMBuzzwordTrainAWQ
33Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
193 Pkt
96,5% · 193/200 Aufg. · 3.667,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
34Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
87 Pkt
43,5% · 87/200 Aufg. · 19,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
35Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 36,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
36Nemotron-Cascade-2-30B-A3B30BNVIDIA HarnessbenchmarkDecision-Benchmark V 1.0
159 Pkt
79,5% · 159/200 Aufg. · 35,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
37Laya0.4BConvai Innovations HarnessbenchmarkDecision-Benchmark V 1.0
122 Pkt
61,0% · 122/200 Aufg. · 14,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorch
38Open-Jev-27B-v1.127BZefan Cai / Open-Jev HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 75,5 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorchBF16
39GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,75 tok/s TG
Prefill 987 · TTFT 26.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
40GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,94 tok/s TG
Prefill 762 · TTFT 15.666 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
41GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,01 tok/s TG
Prefill 441 · TTFT 4.837 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
42Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.100,69 tok/s TG
Prefill 27.110 · TTFT 739 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
43Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
608,35 tok/s TG
Prefill 23.343 · TTFT 414 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
44Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,73 tok/s TG
Prefill 15.397 · TTFT 126 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
45gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,40 tok/s TG
Prefill 15.615 · TTFT 1.677 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
46gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,78 tok/s TG
Prefill 12.359 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
47gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,12 tok/s TG
Prefill 7.867 · TTFT 251 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
48Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,29 tok/s TG
Prefill 273 · TTFT 55.104 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
49Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,47 tok/s TG
Prefill 197 · TTFT 13.734 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
50Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,15 tok/s TG
Prefill 308 · TTFT 64.768 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
51Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,34 tok/s TG
Prefill 243 · TTFT 13.913 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
52Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,74 tok/s TG
Prefill 212 · TTFT 57.889 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
53Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,55 tok/s TG
Prefill 166 · TTFT 13.627 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
54Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,84 tok/s TG
Prefill 277 · TTFT 48.247 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
55Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,57 tok/s TG
Prefill 159 · TTFT 13.491 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
56Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,24 tok/s TG
Prefill 263 · TTFT 57.267 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
57Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,51 tok/s TG
Prefill 185 · TTFT 14.723 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
58gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,30 tok/s TG
Prefill 694 · TTFT 29.007 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
59gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
111,12 tok/s TG
Prefill 616 · TTFT 16.066 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
60gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,18 tok/s TG
Prefill 627 · TTFT 3.155 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
61Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,11 tok/s TG
Prefill 639 · TTFT 44.373 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
62Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,46 tok/s TG
Prefill 476 · TTFT 25.832 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
63Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,41 tok/s TG
Prefill 388 · TTFT 5.855 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
64gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,04 tok/s TG
Prefill 333 · TTFT 61.247 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
65gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,75 tok/s TG
Prefill 305 · TTFT 32.520 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
66gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,30 tok/s TG
Prefill 298 · TTFT 6.721 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
67Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,65 tok/s TG
Prefill 776 · TTFT 29.085 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
68Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,46 tok/s TG
Prefill 592 · TTFT 16.869 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
69Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,54 tok/s TG
Prefill 547 · TTFT 3.535 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
70gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
58,96 tok/s TG
Prefill 818 · TTFT 24.766 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
71gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
97,08 tok/s TG
Prefill 757 · TTFT 13.077 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
72gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
43,23 tok/s TG
Prefill 758 · TTFT 2.613 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
73Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,29 tok/s TG
Prefill 1.115 · TTFT 27.826 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
74Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,58 tok/s TG
Prefill 888 · TTFT 15.224 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
75Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,46 tok/s TG
Prefill 589 · TTFT 4.189 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
76Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,59 tok/s TG
Prefill 2.273 · TTFT 11.329 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
77Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,50 tok/s TG
Prefill 1.715 · TTFT 6.606 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
78Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
138,75 tok/s TG
Prefill 1.439 · TTFT 1.508 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
79Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,25 tok/s TG
Prefill 1.859 · TTFT 13.867 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
80Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,26 tok/s TG
Prefill 1.343 · TTFT 8.459 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
81Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
120,01 tok/s TG
Prefill 1.155 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
82Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,56 tok/s TG
Prefill 1.267 · TTFT 4.040 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
83Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,06 tok/s TG
Prefill 1.284 · TTFT 1.994 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
84Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,10 tok/s TG
Prefill 816 · TTFT 627 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
85Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,58 tok/s TG
Prefill 348 · TTFT 7.358 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
86Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,68 tok/s TG
Prefill 182 · TTFT 2.809 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
87Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,04 tok/s TG
Prefill 1.089 · TTFT 4.703 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
88Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
124,52 tok/s TG
Prefill 1.096 · TTFT 2.336 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
89Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,18 tok/s TG
Prefill 592 · TTFT 865 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
90Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,23 tok/s TG
Prefill 357 · TTFT 14.331 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
91Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,07 tok/s TG
Prefill 383 · TTFT 4.502 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
92Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,64 tok/s TG
Prefill 281 · TTFT 6.718 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
93Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,18 tok/s TG
Prefill 319 · TTFT 8.542 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
94Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
66,43 tok/s TG
Prefill 898 · TTFT 2.781 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
95Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
333,12 tok/s TG
Prefill 1.168 · TTFT 37.996 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
96Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,55 tok/s TG
Prefill 1.000 · TTFT 14.742 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
97Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,84 tok/s TG
Prefill 920 · TTFT 2.098 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
98Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,11 tok/s TG
Prefill 821 · TTFT 2.298 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMopenclaw_cli
99Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
351,55 tok/s TG
Prefill 1.164 · TTFT 38.427 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
100Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,63 tok/s TG
Prefill 993 · TTFT 14.781 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
101Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,94 tok/s TG
Prefill 70 · TTFT 161.804 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
102Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,72 tok/s TG
Prefill 45 · TTFT 32.857 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
103Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,00 tok/s TG
Prefill 15 · TTFT 531 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
104gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
26,57 tok/s TG
Prefill 50 · TTFT 276.964 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
105gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,41 tok/s TG
Prefill 50 · TTFT 226.449 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
106gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,82 tok/s TG
Prefill 40 · TTFT 49.516 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
107command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,02 tok/s TG
Prefill 5 · TTFT 485.856 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
108gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
474,76 tok/s TG
Prefill 1.760 · TTFT 26.540 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
109gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
267,65 tok/s TG
Prefill 1.544 · TTFT 9.962 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
110gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
84,70 tok/s TG
Prefill 1.022 · TTFT 2.264 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
111gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
826,24 tok/s TG
Prefill 3.229 · TTFT 15.223 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
112gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
436,25 tok/s TG
Prefill 3.526 · TTFT 5.370 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
113gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,26 tok/s TG
Prefill 1.113 · TTFT 2.031 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M