Created bymario-alka.dePowered bynoob2claw.detricoma.de
⚡
Performance-Benchmark

Wie schnell ist das Modell?

Roher Durchsatz auf echter Hardware – wie viele Token ein Modell pro Sekunde erzeugt, wie schnell es den Prompt verarbeitet und wie kurz die Zeit bis zum ersten Token ausfällt. Je höher, desto besser.

⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
Reset
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3.484,32 tok/s TG
Prefill 8.256 · TTFT 14.388 ms
10×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
2NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.867,15 tok/s TG
Prefill 8.107 · TTFT 17.054 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
3gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.412,27 tok/s TG
Prefill 19.677 · TTFT 4.107 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
4NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.263,71 tok/s TG
Prefill 9.016 · TTFT 21.818 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmNVFP4
5NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.144,30 tok/s TG
Prefill 10.533 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
6gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.981,08 tok/s TG
Prefill 15.983 · TTFT 5.309 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
7Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.784,65 tok/s TG
Prefill 8.304 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
8NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.775,62 tok/s TG
Prefill 8.642 · TTFT 6.861 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
9Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.774,36 tok/s TG
Prefill 7.850 · TTFT 6.996 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
10gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.755,52 tok/s TG
Prefill 13.910 · TTFT 5.964 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
11Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.706,21 tok/s TG
Prefill 8.777 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
12NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.694,65 tok/s TG
Prefill 7.768 · TTFT 6.482 ms
5×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
13Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.653,11 tok/s TG
Prefill 13.572 · TTFT 6.808 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
14Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.645,78 tok/s TG
Prefill 14.123 · TTFT 6.609 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
15Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.623,26 tok/s TG
Prefill 10.509 · TTFT 7.259 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
16Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.623,15 tok/s TG
Prefill 10.707 · TTFT 7.140 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
17Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.617,88 tok/s TG
Prefill 13.894 · TTFT 6.893 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
18Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.604,55 tok/s TG
Prefill 6.804 · TTFT 8.073 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
19Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.586,19 tok/s TG
Prefill 7.391 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
20North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.573,04 tok/s TG
Prefill 8.004 · TTFT 7.551 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
21Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.528,71 tok/s TG
Prefill 17.513 · TTFT 6.225 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
22Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.525,69 tok/s TG
Prefill 10.623 · TTFT 6.806 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
23Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.499,44 tok/s TG
Prefill 8.022 · TTFT 7.851 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
24Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.476,12 tok/s TG
Prefill 7.819 · TTFT 7.689 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
25Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.439,36 tok/s TG
Prefill 8.063 · TTFT 7.868 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
26gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.425,74 tok/s TG
Prefill 35.639 · TTFT 560 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
27NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.375,08 tok/s TG
Prefill 7.576 · TTFT 7.731 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
28gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.348,35 tok/s TG
Prefill 18.078 · TTFT 1.302 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
29NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.154,42 tok/s TG
Prefill 8.806 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
30NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.134,97 tok/s TG
Prefill 8.757 · TTFT 9.812 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmNVFP4
31Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.132,67 tok/s TG
Prefill 1.930 · TTFT 47.978 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
32gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.105,79 tok/s TG
Prefill 14.121 · TTFT 1.691 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
33gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.103,42 tok/s TG
Prefill 5.051 · TTFT 11.207 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
34Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,15 tok/s TG
Prefill 33.319 · TTFT 976 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
35Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.055,44 tok/s TG
Prefill 10.341 · TTFT 9.706 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
36NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.005,67 tok/s TG
Prefill 7.555 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
37Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
997,65 tok/s TG
Prefill 7.725 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
38Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
985,75 tok/s TG
Prefill 7.733 · TTFT 2.448 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
39Laguna-XS-2.133.4BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
959,22 tok/s TG
Prefill 7.286 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
40Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
954,95 tok/s TG
Prefill 31.797 · TTFT 1.633 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
41Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
944,04 tok/s TG
Prefill 13.438 · TTFT 2.113 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
42Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
913,32 tok/s TG
Prefill 38.043 · TTFT 1.193 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
43gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,59 tok/s TG
Prefill 12.381 · TTFT 1.885 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
44Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,14 tok/s TG
Prefill 9.553 · TTFT 2.416 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
45Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
900,71 tok/s TG
Prefill 9.991 · TTFT 2.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
46Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
899,11 tok/s TG
Prefill 13.942 · TTFT 2.150 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
47Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
890,62 tok/s TG
Prefill 6.480 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
48Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
888,96 tok/s TG
Prefill 12.945 · TTFT 2.202 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
49Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
884,45 tok/s TG
Prefill 33.614 · TTFT 1.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
50NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
883,69 tok/s TG
Prefill 26.055 · TTFT 1.240 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
51Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
869,38 tok/s TG
Prefill 11.044 · TTFT 2.242 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
52Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,55 tok/s TG
Prefill 6.134 · TTFT 2.760 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
53NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
859,79 tok/s TG
Prefill 25.664 · TTFT 1.257 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
54North-Mini-Code-1.030.5BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
859,15 tok/s TG
Prefill 7.281 · TTFT 2.530 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
55NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
847,47 tok/s TG
Prefill 20.262 · TTFT 1.586 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
56NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
837,10 tok/s TG
Prefill 20.352 · TTFT 1.585 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
57Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
833,31 tok/s TG
Prefill 17.472 · TTFT 5.292 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-q4g64
58Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
830,46 tok/s TG
Prefill 3.771 · TTFT 14.928 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMhermes_cli
59Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
829,45 tok/s TG
Prefill 3.778 · TTFT 14.891 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMhermes_cli
60Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
828,36 tok/s TG
Prefill 3.763 · TTFT 14.940 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliQ4_K_M
61Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
818,85 tok/s TG
Prefill 7.089 · TTFT 2.658 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
62Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
814,30 tok/s TG
Prefill 6.898 · TTFT 2.629 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
63Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
803,48 tok/s TG
Prefill 9.780 · TTFT 2.187 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
64Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
799,04 tok/s TG
Prefill 7.237 · TTFT 2.650 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_M
65Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
728,31 tok/s TG
Prefill 10.081 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
66NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
725,25 tok/s TG
Prefill 16.303 · TTFT 1.813 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
67Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
709,24 tok/s TG
Prefill 11.744 · TTFT 2.430 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
68NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
709,02 tok/s TG
Prefill 16.443 · TTFT 1.805 ms
10×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
69NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
708,32 tok/s TG
Prefill 19.583 · TTFT 709 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
70NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
695,91 tok/s TG
Prefill 15.678 · TTFT 892 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
71NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
692,70 tok/s TG
Prefill 19.510 · TTFT 712 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
72NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
689,92 tok/s TG
Prefill 15.701 · TTFT 893 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
73Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
646,94 tok/s TG
Prefill 10.489 · TTFT 10.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
74Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
638,58 tok/s TG
Prefill 306 · TTFT 145.278 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
75Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
623,62 tok/s TG
Prefill 19.024 · TTFT 1.534 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX-4bit
76Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
623,04 tok/s TG
Prefill 6.697 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
77Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
615,23 tok/s TG
Prefill 13.720 · TTFT 797 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
78gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
575,74 tok/s TG
Prefill 4.496 · TTFT 3.743 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
79Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
572,23 tok/s TG
Prefill 1.826 · TTFT 21.491 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
80gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
572,10 tok/s TG
Prefill 10.901 · TTFT 1.915 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
81Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
477,16 tok/s TG
Prefill 18.162 · TTFT 690 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
82NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1
471,33 tok/s TG
Prefill - · TTFT 31 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
83Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
467,09 tok/s TG
Prefill 3.349 · TTFT 5.143 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliQ4_K_M
84NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
466,72 tok/s TG
Prefill 12.079 · TTFT 1.048 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
85NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
462,42 tok/s TG
Prefill 11.388 · TTFT 1.082 ms
5×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
86gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
451,05 tok/s TG
Prefill 32.005 · TTFT 864 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
87Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
448,85 tok/s TG
Prefill 14.780 · TTFT 853 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-q4g64
88gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
448,17 tok/s TG
Prefill 5.809 · TTFT 3.494 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
89Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
447,97 tok/s TG
Prefill 14.674 · TTFT 850 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
90Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
446,60 tok/s TG
Prefill 14.822 · TTFT 850 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX-4bit
91Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
418,77 tok/s TG
Prefill 17.642 · TTFT 1.399 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
92NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
404,72 tok/s TG
Prefill 4.793 · TTFT 5.226 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliIQ4_NL
93Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
397,18 tok/s TG
Prefill 3.476 · TTFT 5.916 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
94Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
385,85 tok/s TG
Prefill 16.933 · TTFT 1.925 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
95gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
372,40 tok/s TG
Prefill 1.508 · TTFT 13.832 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
96Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
371,66 tok/s TG
Prefill 8.745 · TTFT 3.710 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
97gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
361,70 tok/s TG
Prefill 4.756 · TTFT 2.076 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
98Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,01 tok/s TG
Prefill 10.663 · TTFT 3.085 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
99glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
349,28 tok/s TG
Prefill 7.891 · TTFT 3.899 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQ
100gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
346,29 tok/s TG
Prefill 16.028 · TTFT 1.776 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
101Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
341,53 tok/s TG
Prefill 4.662 · TTFT 4.820 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
102Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
319,40 tok/s TG
Prefill 254 · TTFT 73.516 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
103gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
308,36 tok/s TG
Prefill 9.336 · TTFT 1.062 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
104gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
306,80 tok/s TG
Prefill 9.358 · TTFT 1.060 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
105Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
303,07 tok/s TG
Prefill 6.279 · TTFT 2.200 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
106NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
300,10 tok/s TG
Prefill 3.941 · TTFT 2.860 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliIQ4_NL
107Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
299,90 tok/s TG
Prefill 3.515 · TTFT 2.858 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
108Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
287,13 tok/s TG
Prefill 3.082 · TTFT 3.211 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
109Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,86 tok/s TG
Prefill 3.781 · TTFT 10.183 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmAWQ
110Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,09 tok/s TG
Prefill 15.257 · TTFT 775 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
111Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,69 tok/s TG
Prefill 5.149 · TTFT 6.214 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
112NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,31 tok/s TG
Prefill 6.632 · TTFT 325 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
113NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,60 tok/s TG
Prefill 8.173 · TTFT 263 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
114NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
239,27 tok/s TG
Prefill 8.237 · TTFT 261 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
115Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
237,60 tok/s TG
Prefill 6.106 · TTFT 8.357 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawUD-Q4_K_XL
116NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
235,73 tok/s TG
Prefill 6.703 · TTFT 322 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
117glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,82 tok/s TG
Prefill 6.284 · TTFT 2.148 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQ
118gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,02 tok/s TG
Prefill 11.489 · TTFT 2.605 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
119NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
227,41 tok/s TG
Prefill 6.536 · TTFT 346 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmNVFP4
120NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,44 tok/s TG
Prefill 6.517 · TTFT 330 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-4bit
121Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
223,20 tok/s TG
Prefill 12.589 · TTFT 1.123 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
122NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1
218,77 tok/s TG
Prefill - · TTFT 54 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
123Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
214,10 tok/s TG
Prefill 4.633 · TTFT 8.462 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
124glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,45 tok/s TG
Prefill 14.193 · TTFT 1.973 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
125NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,38 tok/s TG
Prefill 5.434 · TTFT 411 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
126gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,09 tok/s TG
Prefill 4.232 · TTFT 467 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
127NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,66 tok/s TG
Prefill 6.076 · TTFT 355 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1NVFP4 W4A16
128Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,39 tok/s TG
Prefill 7.898 · TTFT 1.797 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
129Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
205,63 tok/s TG
Prefill 5.887 · TTFT 2.145 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawUD-Q4_K_XL
130NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
196,02 tok/s TG
Prefill 3.211 · TTFT 670 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliIQ4_NL
131Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
195,16 tok/s TG
Prefill 4.168 · TTFT 11.306 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
132Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,23 tok/s TG
Prefill 3.806 · TTFT 640 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
133Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,33 tok/s TG
Prefill 2.857 · TTFT 5.676 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmAWQ
134Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,18 tok/s TG
Prefill 3.927 · TTFT 11.977 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
135gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,69 tok/s TG
Prefill 2.125 · TTFT 4.654 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
136gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
177,40 tok/s TG
Prefill 11.718 · TTFT 941 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
137NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
175,99 tok/s TG
Prefill 6.612 · TTFT 326 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX 4-bit
138gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
174,07 tok/s TG
Prefill 1.206 · TTFT 16.925 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
139Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
172,41 tok/s TG
Prefill 2.763 · TTFT 700 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
140Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
165,01 tok/s TG
Prefill 3.471 · TTFT 3.864 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
141Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,49 tok/s TG
Prefill 3.209 · TTFT 4.175 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
142Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
162,37 tok/s TG
Prefill 2.928 · TTFT 659 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMhermes_cli
143Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
162,17 tok/s TG
Prefill 2.928 · TTFT 660 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliQ4_K_M
144gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,49 tok/s TG
Prefill 182 · TTFT 97.092 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
145Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
154,69 tok/s TG
Prefill 7.524 · TTFT 257 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
146Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
146,54 tok/s TG
Prefill 6.032 · TTFT 320 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMgodclaw
147Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,72 tok/s TG
Prefill 6.273 · TTFT 308 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclawMLX-q4g64
148glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
144,63 tok/s TG
Prefill 3.247 · TTFT 656 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQ
149NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
139,97 tok/s TG
Prefill 1.744 · TTFT 14.686 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
150Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
132,71 tok/s TG
Prefill 6.165 · TTFT 313 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMtensorfoldgodclaw 1.1.6MLX-4bit
151Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,87 tok/s TG
Prefill 3.206 · TTFT 618 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
152Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 3.410 · TTFT 4.809 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
153Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,94 tok/s TG
Prefill 3.957 · TTFT 3.439 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
154NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
119,24 tok/s TG
Prefill 1.181 · TTFT 9.551 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
155Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,39 tok/s TG
Prefill 1.389 · TTFT 1.421 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
156Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
108,46 tok/s TG
Prefill 1.445 · TTFT 1.367 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
157Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,01 tok/s TG
Prefill 3.668 · TTFT 6.469 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
158Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,22 tok/s TG
Prefill 3.297 · TTFT 7.376 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
159Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,94 tok/s TG
Prefill 3.492 · TTFT 6.829 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
160Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,73 tok/s TG
Prefill 2.339 · TTFT 824 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawUD-Q4_K_XL
161Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,80 tok/s TG
Prefill 1.364 · TTFT 1.448 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
162Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,99 tok/s TG
Prefill 3.096 · TTFT 7.876 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
163glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,50 tok/s TG
Prefill 10.352 · TTFT 1.169 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
164Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,41 tok/s TG
Prefill 3.120 · TTFT 7.835 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
165NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
101,04 tok/s TG
Prefill 1.039 · TTFT 2.074 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
166Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
91,92 tok/s TG
Prefill 3.113 · TTFT 7.635 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
167Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,25 tok/s TG
Prefill 8.339 · TTFT 298 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
168gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
83,56 tok/s TG
Prefill 2.303 · TTFT 859 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
169gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
81,35 tok/s TG
Prefill 998 · TTFT 9.924 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
170Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,14 tok/s TG
Prefill 7.814 · TTFT 243 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAMvLLMgodclawNVFP4
171gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,79 tok/s TG
Prefill 1.062 · TTFT 9.322 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
172Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,43 tok/s TG
Prefill 2.659 · TTFT 3.956 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
173Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,07 tok/s TG
Prefill 2.389 · TTFT 4.453 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
174Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,96 tok/s TG
Prefill 2.540 · TTFT 4.155 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
175Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,06 tok/s TG
Prefill 2.421 · TTFT 9.812 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
176Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,01 tok/s TG
Prefill 2.225 · TTFT 4.791 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
177Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,89 tok/s TG
Prefill 2.246 · TTFT 4.750 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
178Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,45 tok/s TG
Prefill 2.269 · TTFT 4.646 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
179gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,64 tok/s TG
Prefill 5.671 · TTFT 366 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
180Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,55 tok/s TG
Prefill 1.941 · TTFT 1.402 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
181Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,12 tok/s TG
Prefill 3.392 · TTFT 922 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
182Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,94 tok/s TG
Prefill 6.450 · TTFT 379 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
183Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,53 tok/s TG
Prefill 106 · TTFT 20.413 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
184Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,20 tok/s TG
Prefill 1.745 · TTFT 6.003 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
185Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,91 tok/s TG
Prefill 4.040 · TTFT 608 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw
186gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,58 tok/s TG
Prefill 10.520 · TTFT 189 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmBF16
187gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,20 tok/s TG
Prefill 11.058 · TTFT 180 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
188gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,01 tok/s TG
Prefill 11.757 · TTFT 169 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmBF16
189Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,38 tok/s TG
Prefill 1.437 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvllm
190gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,86 tok/s TG
Prefill 6.286 · TTFT 315 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cli
191gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,10 tok/s TG
Prefill 1.020 · TTFT 1.964 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
192gemma4:31b31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,74 tok/s TG
Prefill 938 · TTFT 2.110 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cli
193Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,61 tok/s TG
Prefill 1.738 · TTFT 1.111 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
194Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,58 tok/s TG
Prefill 1.653 · TTFT 1.169 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
195Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,58 tok/s TG
Prefill 1.461 · TTFT 1.321 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
196Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,50 tok/s TG
Prefill 1.394 · TTFT 1.386 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
197Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,15 tok/s TG
Prefill 1.375 · TTFT 1.403 ms
1×NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ
198Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,01 tok/s TG
Prefill 1.371 · TTFT 1.564 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
199Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,91 tok/s TG
Prefill 1.421 · TTFT 1.356 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclaw 0.27.1AWQ
200glm-4.7-flash31.2BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,28 tok/s TG
Prefill 6.200 · TTFT 346 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQ
201gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,07 tok/s TG
Prefill 96 · TTFT 20.531 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
202Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,97 tok/s TG
Prefill 1.121 · TTFT 1.720 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMvLLMgodclawAWQ