Created bymario-alka.dePowered bynoob2claw.detricoma.de
🎮
Graphics card

Keine GPU (CPU-only)

Other
138Benchmarks
48Models
138LLM
0Harness
Best generation
298,1 tok/s
Qwen2.5-0.5B-Instruct
∅ Generation
28,7 tok/s
Schnitt aus 138 Läufen
Best prefill
14.858 tok/s
Prompt processing
Best TTFT
175 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Qwen2.5-0.5B-Instruct läuft am schnellsten auf dieser GPU · 298,1 tok/s
Bester Prefill: 14.858 tok/s · 48 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf Keine GPU (CPU-only) – umschaltbar nach Generation, Prefill oder Kombiwert.

Qwen2.5-0.5B-Instruct0.5B
298,1 tok/s
Qwen3-0.6B0.6B
189,5 tok/s
Qwen2.5-1.5B-Instruct1.5B
126,7 tok/s
gemma-4-E2B-it5B
119,9 tok/s
Qwen3-1.7B1.7B
100,5 tok/s
gemma-4-E4B-it8B
85,2 tok/s
gemma-2-2b-it2B
75,1 tok/s
gpt-oss-20b20B
70,9 tok/s
Anzeige
Performance profile

Durchsatz auf Keine GPU (CPU-only)

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

38628919396,50,002.1054.2106.315Prefill (tok/s)Generation (tok/s)Qwen2.5-0.5B-Instruct - 298,1 tok/s Generation, 5.103 tok/s Prefill, TTFT 62.395 ms (5 Laufe)Qwen2.5-0.5B-InstructQwen3-0.6B - 189,5 tok/s Generation, 4.661 tok/s Prefill, TTFT 91.948 ms (4 Laufe)Qwen3-0.6BLlama-3.2-1B-Instruct - 133,2 tok/s Generation, 3.119 tok/s Prefill, TTFT 91.259 ms (4 Laufe)Llama-3.2-1B-InstructQwen2.5-1.5B-Instruct - 126,7 tok/s Generation, 2.919 tok/s Prefill, TTFT 65.371 ms (3 Laufe)Qwen2.5-1.5B-Instructgemma-4-E2B-it - 119,9 tok/s Generation, 4.370 tok/s Prefill, TTFT 507 ms (1 Lauf)gemma-4-E2B-itQwen3-1.7B - 100,5 tok/s Generation, 3.865 tok/s Prefill, TTFT 710 ms (2 Laufe)Qwen3-1.7Bgemma-4-E4B-it - 85,2 tok/s Generation, 1.963 tok/s Prefill, TTFT 1.056 ms (2 Laufe)gemma-4-E4B-itgemma-2-2b-it - 75,1 tok/s Generation, 1.198 tok/s Prefill, TTFT 172.539 ms (4 Laufe)gemma-2-2b-itgpt-oss-20b - 70,9 tok/s Generation, 491 tok/s Prefill, TTFT 79.001 ms (7 Laufe)gpt-oss-20bQwen2.5-3B-Instruct - 66,0 tok/s Generation, 2.193 tok/s Prefill, TTFT 1.224 ms (2 Laufe)Qwen2.5-3B-InstructLlama-3.2-3B-Instruct - 62,9 tok/s Generation, 2.130 tok/s Prefill, TTFT 1.267 ms (2 Laufe)Llama-3.2-3B-InstructNVIDIA-Nemotron-3-Nano-4B - 56,2 tok/s Generation, 835 tok/s Prefill, TTFT 40.045 ms (4 Laufe)NVIDIA-Nemotron-3-Nan...SmolLM2-1.7B-Instruct - 55,0 tok/s Generation, 3.498 tok/s Prefill, TTFT 1.040 ms (2 Laufe)SmolLM2-1.7B-InstructLlama-3.1-Nemotron-Nano-4B-v1.1 - 49,2 tok/s Generation, 1.978 tok/s Prefill, TTFT 1.328 ms (1 Lauf)Llama-3.1-Nemotron-Na...Qwen3-4B - 48,3 tok/s Generation, 1.590 tok/s Prefill, TTFT 1.704 ms (2 Laufe)Qwen3-4BGemma-4-26B-A4B-it - 47,4 tok/s Generation, 1.385 tok/s Prefill, TTFT 1.479 ms (2 Laufe)Gemma-4-26B-A4B-itgemma-3n-E4B-it - 46,8 tok/s Generation, 1.199 tok/s Prefill, TTFT 1.907 ms (2 Laufe)gemma-3n-E4B-itPhi-3.5-mini-instruct - 41,6 tok/s Generation, 1.815 tok/s Prefill, TTFT 1.555 ms (1 Lauf)Phi-3.5-mini-instructgemma-4-12B-it - 31,7 tok/s Generation, 490 tok/s Prefill, TTFT 4.423 ms (2 Laufe)gemma-4-12B-itQwen2.5-7B-Instruct - 31,5 tok/s Generation, 880 tok/s Prefill, TTFT 3.112 ms (2 Laufe)Qwen2.5-7B-InstructQwen2.5-Coder-7B-Instruct - 31,4 tok/s Generation, 919 tok/s Prefill, TTFT 2.893 ms (2 Laufe)Qwen2.5-Coder-7B-Inst...Qwen3-30B-A3B-Instruct-2507 - 31,2 tok/s Generation, 214 tok/s Prefill, TTFT 61.139 ms (3 Laufe)Qwen3-30B-A3B-Instruc...Mamba-Codestral-7B-v0.1 - 29,3 tok/s Generation, 327 tok/s Prefill, TTFT 8.424 ms (1 Lauf)Mamba-Codestral-7B-v0...Meta-Llama-3.1-8B-Instruct - 29,2 tok/s Generation, 829 tok/s Prefill, TTFT 3.349 ms (2 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3-8B - 28,4 tok/s Generation, 920 tok/s Prefill, TTFT 2.939 ms (2 Laufe)Qwen3-8Bgemma-2-9b-it - 22,0 tok/s Generation, 598 tok/s Prefill, TTFT 3.286 ms (2 Laufe)gemma-2-9b-itOrnith-1.5-9B - 21,9 tok/s Generation, 1.047 tok/s Prefill, TTFT 2.009 ms (1 Lauf)Ornith-1.5-9BMinistral-3-14B-Reasoning-2512 - 17,3 tok/s Generation, 621 tok/s Prefill, TTFT 3.879 ms (1 Lauf)Ministral-3-14B-Reaso...Qwen3-14B - 15,5 tok/s Generation, 423 tok/s Prefill, TTFT 6.536 ms (2 Laufe)Qwen3-14BMistral-Small-3.1-24B-Instruct-2503 - 9,9 tok/s Generation, 268 tok/s Prefill, TTFT 9.350 ms (2 Laufe)Mistral-Small-3.1-24B...Mistral-Small-24B-Instruct-2501 - 9,9 tok/s Generation, 246 tok/s Prefill, TTFT 9.302 ms (2 Laufe)Mistral-Small-24B-Ins...Devstral-Small-2507 - 9,7 tok/s Generation, 427 tok/s Prefill, TTFT 8.728 ms (1 Lauf)Devstral-Small-2507Codestral-22B-v0.1 - 9,7 tok/s Generation, 283 tok/s Prefill, TTFT 10.124 ms (2 Laufe)Codestral-22B-v0.1Devstral-Small-2-24B-Instruct-2512 - 9,2 tok/s Generation, 269 tok/s Prefill, TTFT 9.302 ms (2 Laufe)Devstral-Small-2-24B-...Qwen3-30B-A3B-Thinking-2507 - 8,5 tok/s Generation, 71 tok/s Prefill, TTFT 152.830 ms (1 Lauf)Qwen3-30B-A3B-Thinkin...
Qwen2.5-0.5B-Instruct 298,1 tok/sQwen3-0.6B 189,5 tok/sLlama-3.2-1B-Instruct 133,2 tok/sQwen2.5-1.5B-Instruct 126,7 tok/sgemma-4-E2B-it 119,9 tok/sQwen3-1.7B 100,5 tok/sgemma-4-E4B-it 85,2 tok/sgemma-2-2b-it 75,1 tok/sgpt-oss-20b 70,9 tok/sQwen2.5-3B-Instruct 66,0 tok/sLlama-3.2-3B-Instruct 62,9 tok/sNVIDIA-Nemotron-3-Nano-4B 56,2 tok/sSmolLM2-1.7B-Instruct 55,0 tok/sLlama-3.1-Nemotron-Nano-4B-v1.1 49,2 tok/sQwen3-4B 48,3 tok/sGemma-4-26B-A4B-it 47,4 tok/sgemma-3n-E4B-it 46,8 tok/sPhi-3.5-mini-instruct 41,6 tok/sgemma-4-12B-it 31,7 tok/sQwen2.5-7B-Instruct 31,5 tok/sQwen2.5-Coder-7B-Instruct 31,4 tok/sQwen3-30B-A3B-Instruct-2507 31,2 tok/sMamba-Codestral-7B-v0.1 29,3 tok/sMeta-Llama-3.1-8B-Instruct 29,2 tok/sQwen3-8B 28,4 tok/sgemma-2-9b-it 22,0 tok/sOrnith-1.5-9B 21,9 tok/sMinistral-3-14B-Reasoning-2512 17,3 tok/sQwen3-14B 15,5 tok/sMistral-Small-3.1-24B-Instruct-2503 9,9 tok/sMistral-Small-24B-Instruct-2501 9,9 tok/sDevstral-Small-2507 9,7 tok/sCodestral-22B-v0.1 9,7 tok/sDevstral-Small-2-24B-Instruct-2512 9,2 tok/sQwen3-30B-A3B-Thinking-2507 8,5 tok/s

ENGnach Engine

37328018793,30,001.0302.0603.090Prefill (tok/s)Generation (tok/s)lmstudio-mlx - 298,1 tok/s Generation, 2.509 tok/s Prefill, TTFT 3.036 ms (30 Laufe)lmstudio-mlxOllama - 256,3 tok/s Generation, 1.950 tok/s Prefill, TTFT 3.336 ms (30 Laufe)Ollamallama.cpp - 70,9 tok/s Generation, 119 tok/s Prefill, TTFT 148.288 ms (20 Laufe)llama.cpp
lmstudio-mlx 298,1 tok/sOllama 256,3 tok/sllama.cpp 70,9 tok/s

CPUnach Prozessor

38528919296,20,001.0322.0643.096Prefill (tok/s)Generation (tok/s)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) - 298,1 tok/s Generation, 2.509 tok/s Prefill, TTFT 3.036 ms (30 Laufe)Apple M6 (unified CPU...Apple M6 (unified CPU/GPU SoC) - 256,3 tok/s Generation, 1.950 tok/s Prefill, TTFT 3.336 ms (30 Laufe)Apple M6 (unified CPU...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 70,9 tok/s Generation, 182 tok/s Prefill, TTFT 65.160 ms (6 Laufe)AMD Ryzen Threadrippe...4 x Cortex-A78C + 4 x Cortex-A55 - 19,6 tok/s Generation, 95 tok/s Prefill, TTFT 192.627 ms (10 Laufe)4 x Cortex-A78C + 4 x...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 14,5 tok/s Generation, 82 tok/s Prefill, TTFT 162.130 ms (4 Laufe)Intel(R) Xeon(R) CPU ...
Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) 298,1 tok/sApple M6 (unified CPU/GPU SoC) 256,3 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 70,9 tok/s4 x Cortex-A78C + 4 x Cortex-A55 19,6 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 14,5 tok/s
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf Keine GPU (CPU-only).

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
298,13 tok/s TG
Prefill 14.858 · TTFT 175 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
2Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
256,25 tok/s TG
Prefill 10.267 · TTFT 249 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
3Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,50 tok/s TG
Prefill 11.438 · TTFT 251 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
4Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
164,83 tok/s TG
Prefill 7.014 · TTFT 390 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
5Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,16 tok/s TG
Prefill 7.177 · TTFT 377 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
6Qwen2.5-1.5B-Instruct1.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
126,71 tok/s TG
Prefill 5.137 · TTFT 507 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
7gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
119,93 tok/s TG
Prefill 4.370 · TTFT 507 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
8Qwen2.5-1.5B-Instruct1.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
113,29 tok/s TG
Prefill 3.554 · TTFT 706 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
9Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,53 tok/s TG
Prefill 4.497 · TTFT 604 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
10Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
97,11 tok/s TG
Prefill 5.083 · TTFT 500 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ8_0
11Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,48 tok/s TG
Prefill 3.232 · TTFT 815 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
12gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,23 tok/s TG
Prefill 2.052 · TTFT 990 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
13gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
75,08 tok/s TG
Prefill 2.212 · TTFT 876 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
14gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,85 tok/s TG
Prefill 154 · TTFT 129.121 ms
10×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawMXFP4
15gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,10 tok/s TG
Prefill 2.491 · TTFT 768 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_0
16Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
65,98 tok/s TG
Prefill 2.669 · TTFT 988 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
17gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
64,65 tok/s TG
Prefill 1.873 · TTFT 1.123 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
18Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,86 tok/s TG
Prefill 2.562 · TTFT 1.026 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
19Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
57,50 tok/s TG
Prefill 1.718 · TTFT 1.461 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
20NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
56,16 tok/s TG
Prefill 1.002 · TTFT 2.226 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
21SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
54,97 tok/s TG
Prefill 2.966 · TTFT 1.194 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ8_0
22gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,48 tok/s TG
Prefill 153 · TTFT 64.583 ms
5×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawMXFP4
23gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,05 tok/s TG
Prefill 1.769 · TTFT 1.368 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX MXFP4
24Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
52,92 tok/s TG
Prefill 1.698 · TTFT 1.508 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
25Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,15 tok/s TG
Prefill 1.978 · TTFT 1.328 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
26Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,34 tok/s TG
Prefill 1.927 · TTFT 1.388 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
27Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,35 tok/s TG
Prefill 1.491 · TTFT 1.402 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
28gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,82 tok/s TG
Prefill 1.560 · TTFT 1.426 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
29NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
42,29 tok/s TG
Prefill 1.495 · TTFT 1.438 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
30Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
41,82 tok/s TG
Prefill 1.253 · TTFT 2.021 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
31Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
41,56 tok/s TG
Prefill 1.815 · TTFT 1.555 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
32Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
41,55 tok/s TG
Prefill 1.278 · TTFT 1.556 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
33gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
39,36 tok/s TG
Prefill 838 · TTFT 2.388 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
34NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,84 tok/s TG
Prefill 769 · TTFT 2.861 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
35gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,84 tok/s TG
Prefill 1.030 · TTFT 2.057 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliMXFP4
36SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,49 tok/s TG
Prefill 4.031 · TTFT 886 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX bf16
37gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,69 tok/s TG
Prefill 616 · TTFT 3.219 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
38Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,46 tok/s TG
Prefill 1.123 · TTFT 2.322 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
39Qwen2.5-Coder-7B-Instruct7.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,36 tok/s TG
Prefill 1.117 · TTFT 2.334 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
40Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,23 tok/s TG
Prefill 273 · TTFT 107.591 ms
10×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41Mamba-Codestral-7B-v0.17BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,25 tok/s TG
Prefill 327 · TTFT 8.424 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
42Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,20 tok/s TG
Prefill 1.076 · TTFT 2.447 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
43gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,63 tok/s TG
Prefill 364 · TTFT 5.626 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
44gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,43 tok/s TG
Prefill 143 · TTFT 13.839 ms
1×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawMXFP4
45Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,42 tok/s TG
Prefill 1.096 · TTFT 2.410 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
46Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,30 tok/s TG
Prefill 637 · TTFT 3.902 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
47Qwen2.5-Coder-7B-Instruct7.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,21 tok/s TG
Prefill 722 · TTFT 3.452 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
48Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
26,14 tok/s TG
Prefill 582 · TTFT 4.250 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
49Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,98 tok/s TG
Prefill 218 · TTFT 59.755 ms
5×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
50Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,96 tok/s TG
Prefill 745 · TTFT 3.467 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
51Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,50 tok/s TG
Prefill 152 · TTFT 16.071 ms
1×Keine GPU (CPU-only) iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
52gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,98 tok/s TG
Prefill 646 · TTFT 3.068 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
53Ornith-1.5-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,94 tok/s TG
Prefill 1.047 · TTFT 2.009 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit (OptiQ)
54gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,31 tok/s TG
Prefill 550 · TTFT 3.503 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_0
55Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,64 tok/s TG
Prefill 135 · TTFT 103.828 ms
5×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
56Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,33 tok/s TG
Prefill 171 · TTFT 178.576 ms
10×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
57Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
17,33 tok/s TG
Prefill 621 · TTFT 3.879 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
58Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,53 tok/s TG
Prefill 525 · TTFT 4.974 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
59gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,47 tok/s TG
Prefill 97 · TTFT 222.547 ms
10×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
60Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,03 tok/s TG
Prefill 321 · TTFT 8.097 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
61Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,17 tok/s TG
Prefill 122 · TTFT 228.054 ms
10×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
62Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,93 tok/s TG
Prefill 95 · TTFT 136.105 ms
5×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
63Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,74 tok/s TG
Prefill 85 · TTFT 29.146 ms
1×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
64Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,93 tok/s TG
Prefill 290 · TTFT 8.335 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
65Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,90 tok/s TG
Prefill 266 · TTFT 8.275 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
66gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,77 tok/s TG
Prefill 89 · TTFT 119.492 ms
5×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
67Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,69 tok/s TG
Prefill 427 · TTFT 8.728 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
68Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,65 tok/s TG
Prefill 325 · TTFT 8.859 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
69Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,20 tok/s TG
Prefill 261 · TTFT 8.641 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
70Qwen2.5-1.5B-Instruct1.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,14 tok/s TG
Prefill 67 · TTFT 194.902 ms
5×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
71Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,89 tok/s TG
Prefill 241 · TTFT 11.388 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_0
72Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,85 tok/s TG
Prefill 276 · TTFT 9.964 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
73Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,73 tok/s TG
Prefill 245 · TTFT 10.366 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
74Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,52 tok/s TG
Prefill 71 · TTFT 152.830 ms
5×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
75Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,47 tok/s TG
Prefill 226 · TTFT 10.329 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
76Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,04 tok/s TG
Prefill 108 · TTFT 227.805 ms
10×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
77NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,97 tok/s TG
Prefill 72 · TTFT 153.653 ms
5×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
78gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,94 tok/s TG
Prefill 52 · TTFT 404.593 ms
10×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
79gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,49 tok/s TG
Prefill 35 · TTFT 283.919 ms
5×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
80Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,43 tok/s TG
Prefill 83 · TTFT 139.346 ms
5×Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAMllama.cppopenclaw_cliQ4_K_M
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf Keine GPU (CPU-only).

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – Keine GPU (CPU-only)

HerstellerOther
Best generation298,1 tok/s
Best prefill14.858 tok/s
Models48
Messläufe (Performance)138