🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,50 tok/s TG Prefill 11.438 · TTFT 251 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 2 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,35 tok/s TG Prefill 1.491 · TTFT 1.402 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 3 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,20 tok/s TG Prefill 261 · TTFT 8.641 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 4 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,93 tok/s TG Prefill 290 · TTFT 8.335 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 5 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,90 tok/s TG Prefill 266 · TTFT 8.275 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 6 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,69 tok/s TG Prefill 427 · TTFT 8.728 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 7 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,65 tok/s TG Prefill 325 · TTFT 8.859 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 8 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,05 tok/s TG Prefill 1.769 · TTFT 1.368 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX MXFP4 | Details → | |
| 9 | Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,53 tok/s TG Prefill 525 · TTFT 4.974 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 10 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,33 tok/s TG Prefill 621 · TTFT 3.879 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 11 | Ornith-1.5-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,94 tok/s TG Prefill 1.047 · TTFT 2.009 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit (OptiQ) | Details → | |
| 12 | gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,82 tok/s TG Prefill 1.560 · TTFT 1.426 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 13 | gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,98 tok/s TG Prefill 646 · TTFT 3.068 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 14 | Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,42 tok/s TG Prefill 1.096 · TTFT 2.410 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 15 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,20 tok/s TG Prefill 1.076 · TTFT 2.447 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 16 | Qwen2.5-Coder-7B-Instruct7.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,36 tok/s TG Prefill 1.117 · TTFT 2.334 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 17 | Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,46 tok/s TG Prefill 1.123 · TTFT 2.322 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 18 | Mamba-Codestral-7B-v0.17BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,25 tok/s TG Prefill 327 · TTFT 8.424 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 19 | Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,15 tok/s TG Prefill 1.978 · TTFT 1.328 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 20 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 56,16 tok/s TG Prefill 1.002 · TTFT 2.226 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 21 | Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,34 tok/s TG Prefill 1.927 · TTFT 1.388 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 22 | Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,56 tok/s TG Prefill 1.815 · TTFT 1.555 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 23 | Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,86 tok/s TG Prefill 2.562 · TTFT 1.026 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 24 | Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 65,98 tok/s TG Prefill 2.669 · TTFT 988 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 25 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,08 tok/s TG Prefill 2.212 · TTFT 876 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 26 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,49 tok/s TG Prefill 4.031 · TTFT 886 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX bf16 | Details → | |
| 27 | Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,53 tok/s TG Prefill 4.497 · TTFT 604 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 28 | Qwen2.5-1.5B-Instruct1.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 126,71 tok/s TG Prefill 5.137 · TTFT 507 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 29 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 133,16 tok/s TG Prefill 7.177 · TTFT 377 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 30 | Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 298,13 tok/s TG Prefill 14.858 · TTFT 175 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 31 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,55 tok/s TG Prefill 1.278 · TTFT 1.556 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliNVFP4 | Details → | |
| 32 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,63 tok/s TG Prefill 364 · TTFT 5.626 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 33 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,65 tok/s TG Prefill 1.873 · TTFT 1.123 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 34 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,84 tok/s TG Prefill 769 · TTFT 2.861 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 35 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,29 tok/s TG Prefill 1.495 · TTFT 1.438 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliNVFP4 | Details → | |
| 36 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,85 tok/s TG Prefill 276 · TTFT 9.964 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 37 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,73 tok/s TG Prefill 245 · TTFT 10.366 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 38 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,47 tok/s TG Prefill 226 · TTFT 10.329 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 39 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,89 tok/s TG Prefill 241 · TTFT 11.388 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_0 | Details → | |
| 40 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,84 tok/s TG Prefill 1.030 · TTFT 2.057 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliMXFP4 | Details → | |
| 41 | Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,03 tok/s TG Prefill 321 · TTFT 8.097 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 42 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,69 tok/s TG Prefill 616 · TTFT 3.219 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliNVFP4 | Details → | |
| 43 | gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,31 tok/s TG Prefill 550 · TTFT 3.503 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_0 | Details → | |
| 44 | Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,96 tok/s TG Prefill 745 · TTFT 3.467 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 45 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,14 tok/s TG Prefill 582 · TTFT 4.250 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 46 | Qwen2.5-Coder-7B-Instruct7.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,21 tok/s TG Prefill 722 · TTFT 3.452 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 47 | Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,30 tok/s TG Prefill 637 · TTFT 3.902 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 48 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,23 tok/s TG Prefill 2.052 · TTFT 990 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliNVFP4 | Details → | |
| 49 | gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,36 tok/s TG Prefill 838 · TTFT 2.388 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 50 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,93 tok/s TG Prefill 4.370 · TTFT 507 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliNVFP4 | Details → | |
| 51 | Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,82 tok/s TG Prefill 1.253 · TTFT 2.021 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 52 | Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,92 tok/s TG Prefill 1.698 · TTFT 1.508 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 53 | Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,50 tok/s TG Prefill 1.718 · TTFT 1.461 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 54 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,10 tok/s TG Prefill 2.491 · TTFT 768 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_0 | Details → | |
| 55 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,97 tok/s TG Prefill 2.966 · TTFT 1.194 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ8_0 | Details → | |
| 56 | Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,48 tok/s TG Prefill 3.232 · TTFT 815 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 57 | Qwen2.5-1.5B-Instruct1.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 113,29 tok/s TG Prefill 3.554 · TTFT 706 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 58 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 97,11 tok/s TG Prefill 5.083 · TTFT 500 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ8_0 | Details → | |
| 59 | Qwen2.5-0.5B-Instruct0.5BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 256,25 tok/s TG Prefill 10.267 · TTFT 249 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 60 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,83 tok/s TG Prefill 7.014 · TTFT 390 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → | |
| 61 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 0,69 Bilder/min 87,09 s je Bild · 4 Motive | 1× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | comfyuigodclawINT8 | Details → | |
| 62 | Z-Image6BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 0,50 Bilder/min 119,66 s je Bild · 4 Motive | 1× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | comfyuigodclawBF16 | Details → | |
| 63 | Z-Image-Turbo6BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 4,47 Bilder/min 13,42 s je Bild · 4 Motive | 1× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | comfyuigodclawBF16 | Details → | |
| 64 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 1,51 Bilder/min 39,85 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 65 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 1,47 Bilder/min 40,81 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 66 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 1,37 Bilder/min 43,71 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 67 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 1,51 Bilder/min 39,61 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 68 | Qwen-Image-2.17BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 3,67 Bilder/min 16,34 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | godclaw | Details → | |
| 69 | Z-Image-Turbo6BQwen (Alibaba) Harness benchmarkBildgenerierung Cyberpunk - KI-Rechenzentrum V1 | 32,56 Bilder/min 1,84 s je Bild · 4 Motive | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | godclaw | Details → | |
| 70 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 317,00 tok/s TG Prefill 14.849 · TTFT 2.492 ms | 10× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 71 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,35 tok/s TG Prefill 11.565 · TTFT 1.219 ms | 5× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 72 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,39 tok/s TG Prefill 5.909 · TTFT 412 ms | 1× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 73 | Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,25 tok/s TG Prefill 8.339 · TTFT 298 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 74 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 356,01 tok/s TG Prefill 10.663 · TTFT 3.085 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 75 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,39 tok/s TG Prefill 7.898 · TTFT 1.797 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 76 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,91 tok/s TG Prefill 4.040 · TTFT 608 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 77 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 385,85 tok/s TG Prefill 16.933 · TTFT 1.925 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 78 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 223,20 tok/s TG Prefill 12.589 · TTFT 1.123 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 79 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,94 tok/s TG Prefill 6.450 · TTFT 379 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 80 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,94 tok/s TG Prefill 3.492 · TTFT 6.829 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 81 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,96 tok/s TG Prefill 2.540 · TTFT 4.155 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 82 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.653 · TTFT 1.169 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 83 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,01 tok/s TG Prefill 3.668 · TTFT 6.469 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 84 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,43 tok/s TG Prefill 2.659 · TTFT 3.956 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 85 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,61 tok/s TG Prefill 1.738 · TTFT 1.111 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 86 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 447,97 tok/s TG Prefill 14.674 · TTFT 850 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 87 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,54 tok/s TG Prefill 6.032 · TTFT 320 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 88 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 847,47 tok/s TG Prefill 20.262 · TTFT 1.586 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 89 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 689,92 tok/s TG Prefill 15.701 · TTFT 893 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 90 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 244,31 tok/s TG Prefill 6.632 · TTFT 325 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 91 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 477,16 tok/s TG Prefill 18.162 · TTFT 690 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 92 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,69 tok/s TG Prefill 7.524 · TTFT 257 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 93 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 859,79 tok/s TG Prefill 25.664 · TTFT 1.257 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 94 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 692,70 tok/s TG Prefill 19.510 · TTFT 712 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 95 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,27 tok/s TG Prefill 8.237 · TTFT 261 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 96 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 195,16 tok/s TG Prefill 4.168 · TTFT 11.306 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 97 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,01 tok/s TG Prefill 3.471 · TTFT 3.864 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 98 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,46 tok/s TG Prefill 1.445 · TTFT 1.367 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 99 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 883,69 tok/s TG Prefill 26.055 · TTFT 1.240 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 100 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 708,32 tok/s TG Prefill 19.583 · TTFT 709 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 101 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,60 tok/s TG Prefill 8.173 · TTFT 263 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 102 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,22 tok/s TG Prefill 3.297 · TTFT 7.376 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 103 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,07 tok/s TG Prefill 2.389 · TTFT 4.453 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 104 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.461 · TTFT 1.321 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 105 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 184,18 tok/s TG Prefill 3.927 · TTFT 11.977 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 106 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,49 tok/s TG Prefill 3.209 · TTFT 4.175 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 107 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,80 tok/s TG Prefill 1.364 · TTFT 1.448 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 108 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 837,10 tok/s TG Prefill 20.352 · TTFT 1.585 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 109 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 695,91 tok/s TG Prefill 15.678 · TTFT 892 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 110 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 226,44 tok/s TG Prefill 6.517 · TTFT 330 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 111 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,99 tok/s TG Prefill 3.096 · TTFT 7.876 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 112 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,89 tok/s TG Prefill 2.246 · TTFT 4.750 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 113 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,15 tok/s TG Prefill 1.375 · TTFT 1.403 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 114 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,41 tok/s TG Prefill 3.120 · TTFT 7.835 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 115 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,01 tok/s TG Prefill 2.225 · TTFT 4.791 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 116 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,50 tok/s TG Prefill 1.394 · TTFT 1.386 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 117 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,60 tok/s TG Prefill 6.106 · TTFT 8.357 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 118 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,63 tok/s TG Prefill 5.887 · TTFT 2.145 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 119 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,73 tok/s TG Prefill 2.339 · TTFT 824 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 120 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 91,92 tok/s TG Prefill 3.113 · TTFT 7.635 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 121 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,45 tok/s TG Prefill 2.269 · TTFT 4.646 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 122 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,91 tok/s TG Prefill 1.421 · TTFT 1.356 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 123 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,01 tok/s TG Prefill 1.371 · TTFT 1.564 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 124 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 623,62 tok/s TG Prefill 19.024 · TTFT 1.534 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 125 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 446,60 tok/s TG Prefill 14.822 · TTFT 850 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 126 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 132,71 tok/s TG Prefill 6.165 · TTFT 313 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 127 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 833,31 tok/s TG Prefill 17.472 · TTFT 5.292 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 128 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 448,85 tok/s TG Prefill 14.780 · TTFT 853 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 129 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 145,72 tok/s TG Prefill 6.273 · TTFT 308 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 130 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,06 tok/s TG Prefill 2.421 · TTFT 9.812 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 131 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,20 tok/s TG Prefill 1.745 · TTFT 6.003 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 132 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,97 tok/s TG Prefill 1.121 · TTFT 1.720 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 133 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 345,95 tok/s TG Prefill 6.384 · TTFT 6.682 ms | 10× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 134 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 295,95 tok/s TG Prefill 5.287 · TTFT 2.559 ms | 5× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 135 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 191,35 tok/s TG Prefill 2.201 · TTFT 905 ms | 1× | NVIDIA GeForce RTX 5090 iAMD Ryzen 7 5800X3D 8-Core Processor · 63 GB RAM | stratagodclawIQ2_XS | Details → | |
| 136 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 725,25 tok/s TG Prefill 16.303 · TTFT 1.813 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 137 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,72 tok/s TG Prefill 12.079 · TTFT 1.048 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 138 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,66 tok/s TG Prefill 6.076 · TTFT 355 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 139 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2.867,15 tok/s TG Prefill 8.107 · TTFT 17.054 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 140 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.375,08 tok/s TG Prefill 7.576 · TTFT 7.731 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 141 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 175,99 tok/s TG Prefill 6.612 · TTFT 326 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 142 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 709,02 tok/s TG Prefill 16.443 · TTFT 1.805 ms | 10× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 143 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 462,42 tok/s TG Prefill 11.388 · TTFT 1.082 ms | 5× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 144 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,38 tok/s TG Prefill 5.434 · TTFT 411 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 145 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3.484,32 tok/s TG Prefill 8.256 · TTFT 14.388 ms | 10× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 146 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.694,65 tok/s TG Prefill 7.768 · TTFT 6.482 ms | 5× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 147 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 235,73 tok/s TG Prefill 6.703 · TTFT 322 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 148 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1 | 218,77 tok/s TG Prefill - · TTFT 54 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 149 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1 | 471,33 tok/s TG Prefill - · TTFT 31 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 150 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 344,40 tok/s TG Prefill 16.771 · TTFT 2.037 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | tensorfoldgodclaw 1.1.5NVFP4/MXFP8 | Details → | |
| 151 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 244,85 tok/s TG Prefill 14.238 · TTFT 934 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | tensorfoldgodclaw 1.1.5NVFP4/MXFP8 | Details → | |
| 152 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,79 tok/s TG Prefill 5.764 · TTFT 344 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | tensorfoldgodclaw 1.1.5NVFP4/MXFP8 | Details → | |
| 153 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 141,98 tok/s TG Prefill 4.212 · TTFT 12.237 ms | 10× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 154 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 124,89 tok/s TG Prefill 2.476 · TTFT 6.821 ms | 5× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 155 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,50 tok/s TG Prefill 1.366 · TTFT 1.420 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 156 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,86 tok/s TG Prefill 2.806 · TTFT 12.191 ms | 10× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_0 | Details → | |
| 157 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,80 tok/s TG Prefill 1.943 · TTFT 7.408 ms | 5× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_0 | Details → | |
| 158 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,20 tok/s TG Prefill 1.300 · TTFT 1.660 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_0 | Details → | |
| 159 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,99 tok/s TG Prefill 5.833 · TTFT 17.334 ms | 10× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 160 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,97 tok/s TG Prefill 3.029 · TTFT 9.456 ms | 5× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 161 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,15 tok/s TG Prefill 1.472 · TTFT 1.659 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 162 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 200,47 tok/s TG Prefill 5.303 · TTFT 7.750 ms | 10× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 163 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,73 tok/s TG Prefill 3.482 · TTFT 4.698 ms | 5× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 164 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,41 tok/s TG Prefill 2.523 · TTFT 858 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 165 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 111,85 tok/s TG Prefill 2.041 · TTFT 17.689 ms | 10× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 166 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 697,38 tok/s TG Prefill 14.373 · TTFT 1.721 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 167 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 417,52 tok/s TG Prefill 12.747 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 168 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 127,28 tok/s TG Prefill 8.225 · TTFT 296 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 169 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,06 tok/s TG Prefill 1.478 · TTFT 11.284 ms | 5× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 170 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,95 tok/s TG Prefill 919 · TTFT 2.243 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 171 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,08 tok/s TG Prefill 1.548 · TTFT 12.948 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 172 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,67 tok/s TG Prefill 1.446 · TTFT 6.855 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 173 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,23 tok/s TG Prefill 1.354 · TTFT 1.459 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 174 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 136,58 tok/s TG Prefill 2.934 · TTFT 8.734 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 175 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,18 tok/s TG Prefill 2.075 · TTFT 5.320 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 176 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,10 tok/s TG Prefill 1.729 · TTFT 1.247 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 177 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 169,42 tok/s TG Prefill 2.873 · TTFT 7.817 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 178 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,96 tok/s TG Prefill 2.158 · TTFT 4.629 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 179 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,77 tok/s TG Prefill 1.830 · TTFT 1.055 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 180 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 161,05 tok/s TG Prefill 5.256 · TTFT 6.170 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 181 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,11 tok/s TG Prefill 899 · TTFT 2.279 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 182 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 129,46 tok/s TG Prefill 3.442 · TTFT 3.808 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 183 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,15 tok/s TG Prefill 2.472 · TTFT 986 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 184 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,28 tok/s TG Prefill 4.282 · TTFT 4.702 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 185 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,02 tok/s TG Prefill 3.859 · TTFT 2.570 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 186 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,78 tok/s TG Prefill 3.326 · TTFT 594 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 187 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,87 tok/s TG Prefill 1.288 · TTFT 1.499 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 188 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,08 tok/s TG Prefill 1.293 · TTFT 1.669 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_0 | Details → | |
| 189 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,08 tok/s TG Prefill 1.575 · TTFT 1.551 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 190 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,74 tok/s TG Prefill 2.529 · TTFT 846 ms | 1× | NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 191 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,07 tok/s TG Prefill 96 · TTFT 20.531 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 192 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,97 tok/s TG Prefill 1.744 · TTFT 14.686 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 193 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,24 tok/s TG Prefill 1.181 · TTFT 9.551 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 194 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,04 tok/s TG Prefill 1.039 · TTFT 2.074 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 195 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 341,53 tok/s TG Prefill 4.662 · TTFT 4.820 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 196 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 299,90 tok/s TG Prefill 3.515 · TTFT 2.858 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 197 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 172,41 tok/s TG Prefill 2.763 · TTFT 700 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 198 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 371,66 tok/s TG Prefill 8.745 · TTFT 3.710 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 199 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 303,07 tok/s TG Prefill 6.279 · TTFT 2.200 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 200 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,23 tok/s TG Prefill 3.806 · TTFT 640 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 201 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 448,17 tok/s TG Prefill 5.809 · TTFT 3.494 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 202 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 361,70 tok/s TG Prefill 4.756 · TTFT 2.076 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 203 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,09 tok/s TG Prefill 4.232 · TTFT 467 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 204 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 623,04 tok/s TG Prefill 6.697 · TTFT 15.390 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 205 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 646,94 tok/s TG Prefill 10.489 · TTFT 10.971 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 206 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 615,23 tok/s TG Prefill 13.720 · TTFT 797 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 207 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 575,74 tok/s TG Prefill 4.496 · TTFT 3.743 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 208 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 709,24 tok/s TG Prefill 11.744 · TTFT 2.430 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 209 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 728,31 tok/s TG Prefill 10.081 · TTFT 2.619 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 210 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 902,14 tok/s TG Prefill 9.553 · TTFT 2.416 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 211 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 884,45 tok/s TG Prefill 33.614 · TTFT 1.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 212 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 902,59 tok/s TG Prefill 12.381 · TTFT 1.885 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 213 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 913,32 tok/s TG Prefill 38.043 · TTFT 1.193 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 214 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 900,71 tok/s TG Prefill 9.991 · TTFT 2.386 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 215 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 899,11 tok/s TG Prefill 13.942 · TTFT 2.150 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 216 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 954,95 tok/s TG Prefill 31.797 · TTFT 1.633 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 217 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 985,75 tok/s TG Prefill 7.733 · TTFT 2.448 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 218 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 997,65 tok/s TG Prefill 7.725 · TTFT 2.444 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 219 | NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.005,67 tok/s TG Prefill 7.555 · TTFT 2.444 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 220 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.055,44 tok/s TG Prefill 10.341 · TTFT 9.706 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 221 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 944,04 tok/s TG Prefill 13.438 · TTFT 2.113 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 222 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.060,15 tok/s TG Prefill 33.319 · TTFT 976 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 223 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.103,42 tok/s TG Prefill 5.051 · TTFT 11.207 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 224 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.154,42 tok/s TG Prefill 8.806 · TTFT 2.065 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 225 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.348,35 tok/s TG Prefill 18.078 · TTFT 1.302 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 226 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.105,79 tok/s TG Prefill 14.121 · TTFT 1.691 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 227 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.425,74 tok/s TG Prefill 35.639 · TTFT 560 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 228 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 799,04 tok/s TG Prefill 7.237 · TTFT 2.650 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 229 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.439,36 tok/s TG Prefill 8.063 · TTFT 7.868 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 230 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 818,85 tok/s TG Prefill 7.089 · TTFT 2.658 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 231 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.499,44 tok/s TG Prefill 8.022 · TTFT 7.851 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 232 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 814,30 tok/s TG Prefill 6.898 · TTFT 2.629 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 233 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.476,12 tok/s TG Prefill 7.819 · TTFT 7.689 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 234 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 869,38 tok/s TG Prefill 11.044 · TTFT 2.242 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 235 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.528,71 tok/s TG Prefill 17.513 · TTFT 6.225 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 236 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 803,48 tok/s TG Prefill 9.780 · TTFT 2.187 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 237 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 861,55 tok/s TG Prefill 6.134 · TTFT 2.760 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 238 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 890,62 tok/s TG Prefill 6.480 · TTFT 2.651 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 239 | North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 859,15 tok/s TG Prefill 7.281 · TTFT 2.530 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 240 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 888,96 tok/s TG Prefill 12.945 · TTFT 2.202 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 241 | Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 959,22 tok/s TG Prefill 7.286 · TTFT 2.879 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 242 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.525,69 tok/s TG Prefill 10.623 · TTFT 6.806 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 243 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.604,55 tok/s TG Prefill 6.804 · TTFT 8.073 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 244 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.586,19 tok/s TG Prefill 7.391 · TTFT 7.492 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 245 | North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.573,04 tok/s TG Prefill 8.004 · TTFT 7.551 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 246 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.617,88 tok/s TG Prefill 13.894 · TTFT 6.893 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 247 | Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.706,21 tok/s TG Prefill 8.777 · TTFT 7.343 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 248 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.623,26 tok/s TG Prefill 10.509 · TTFT 7.259 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 249 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.653,11 tok/s TG Prefill 13.572 · TTFT 6.808 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 250 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.623,15 tok/s TG Prefill 10.707 · TTFT 7.140 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → |

