⚡
Performance-Benchmark
Wie schnell ist das Modell?
Roher Durchsatz auf echter Hardware – wie viele Token ein Modell pro Sekunde erzeugt, wie schnell es den Prompt verarbeitet und wie kurz die Zeit bis zum ersten Token ausfällt. Je höher, desto besser.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3.484,32 tok/s TG Prefill 8.256 · TTFT 14.388 ms | 10× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 2 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 2.867,15 tok/s TG Prefill 8.107 · TTFT 17.054 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 3 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.694,65 tok/s TG Prefill 7.768 · TTFT 6.482 ms | 5× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 4 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.375,08 tok/s TG Prefill 7.576 · TTFT 7.731 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 5 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.132,67 tok/s TG Prefill 1.930 · TTFT 47.978 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 6 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 883,69 tok/s TG Prefill 26.055 · TTFT 1.240 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 7 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 859,79 tok/s TG Prefill 25.664 · TTFT 1.257 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 8 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 847,47 tok/s TG Prefill 20.262 · TTFT 1.586 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 9 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 837,10 tok/s TG Prefill 20.352 · TTFT 1.585 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 10 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 833,31 tok/s TG Prefill 17.472 · TTFT 5.292 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 11 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 725,25 tok/s TG Prefill 16.303 · TTFT 1.813 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 12 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 709,02 tok/s TG Prefill 16.443 · TTFT 1.805 ms | 10× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 13 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 708,32 tok/s TG Prefill 19.583 · TTFT 709 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 14 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 695,91 tok/s TG Prefill 15.678 · TTFT 892 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 15 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 692,70 tok/s TG Prefill 19.510 · TTFT 712 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 16 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 689,92 tok/s TG Prefill 15.701 · TTFT 893 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 638,58 tok/s TG Prefill 306 · TTFT 145.278 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 18 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 623,62 tok/s TG Prefill 19.024 · TTFT 1.534 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 19 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,23 tok/s TG Prefill 1.826 · TTFT 21.491 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 20 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 477,16 tok/s TG Prefill 18.162 · TTFT 690 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 21 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1 | 471,33 tok/s TG Prefill - · TTFT 31 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 22 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,72 tok/s TG Prefill 12.079 · TTFT 1.048 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 23 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 462,42 tok/s TG Prefill 11.388 · TTFT 1.082 ms | 5× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 24 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 448,85 tok/s TG Prefill 14.780 · TTFT 853 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 25 | gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 448,17 tok/s TG Prefill 5.809 · TTFT 3.494 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 26 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 447,97 tok/s TG Prefill 14.674 · TTFT 850 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 27 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 446,60 tok/s TG Prefill 14.822 · TTFT 850 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 28 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 385,85 tok/s TG Prefill 16.933 · TTFT 1.925 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 29 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 371,66 tok/s TG Prefill 8.745 · TTFT 3.710 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 30 | gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 361,70 tok/s TG Prefill 4.756 · TTFT 2.076 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 356,01 tok/s TG Prefill 10.663 · TTFT 3.085 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 32 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 341,53 tok/s TG Prefill 4.662 · TTFT 4.820 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 33 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,40 tok/s TG Prefill 254 · TTFT 73.516 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 34 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 303,07 tok/s TG Prefill 6.279 · TTFT 2.200 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 299,90 tok/s TG Prefill 3.515 · TTFT 2.858 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 244,31 tok/s TG Prefill 6.632 · TTFT 325 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 37 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,60 tok/s TG Prefill 8.173 · TTFT 263 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 38 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,27 tok/s TG Prefill 8.237 · TTFT 261 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 39 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,60 tok/s TG Prefill 6.106 · TTFT 8.357 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 40 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 235,73 tok/s TG Prefill 6.703 · TTFT 322 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 41 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 226,44 tok/s TG Prefill 6.517 · TTFT 330 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-4bit | Details → | |
| 42 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 223,20 tok/s TG Prefill 12.589 · TTFT 1.123 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 43 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1 | 218,77 tok/s TG Prefill - · TTFT 54 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 44 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,38 tok/s TG Prefill 5.434 · TTFT 411 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 45 | gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,09 tok/s TG Prefill 4.232 · TTFT 467 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 46 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,66 tok/s TG Prefill 6.076 · TTFT 355 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 47 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,39 tok/s TG Prefill 7.898 · TTFT 1.797 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 48 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,63 tok/s TG Prefill 5.887 · TTFT 2.145 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 49 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 195,16 tok/s TG Prefill 4.168 · TTFT 11.306 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 50 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,23 tok/s TG Prefill 3.806 · TTFT 640 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 51 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 184,18 tok/s TG Prefill 3.927 · TTFT 11.977 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 52 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 175,99 tok/s TG Prefill 6.612 · TTFT 326 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX 4-bit | Details → | |
| 53 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 172,41 tok/s TG Prefill 2.763 · TTFT 700 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 54 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,01 tok/s TG Prefill 3.471 · TTFT 3.864 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 55 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,49 tok/s TG Prefill 3.209 · TTFT 4.175 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 56 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,69 tok/s TG Prefill 7.524 · TTFT 257 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 57 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,54 tok/s TG Prefill 6.032 · TTFT 320 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | godclaw | Details → | |
| 58 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 145,72 tok/s TG Prefill 6.273 · TTFT 308 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclawMLX-q4g64 | Details → | |
| 59 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,97 tok/s TG Prefill 1.744 · TTFT 14.686 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 60 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 132,71 tok/s TG Prefill 6.165 · TTFT 313 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | tensorfoldgodclaw 1.1.6MLX-4bit | Details → | |
| 61 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,24 tok/s TG Prefill 1.181 · TTFT 9.551 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 62 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,39 tok/s TG Prefill 1.389 · TTFT 1.421 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 63 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,46 tok/s TG Prefill 1.445 · TTFT 1.367 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 64 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,01 tok/s TG Prefill 3.668 · TTFT 6.469 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 65 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,22 tok/s TG Prefill 3.297 · TTFT 7.376 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 66 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,94 tok/s TG Prefill 3.492 · TTFT 6.829 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 67 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,73 tok/s TG Prefill 2.339 · TTFT 824 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 68 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,80 tok/s TG Prefill 1.364 · TTFT 1.448 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 69 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,99 tok/s TG Prefill 3.096 · TTFT 7.876 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 70 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,41 tok/s TG Prefill 3.120 · TTFT 7.835 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 71 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,04 tok/s TG Prefill 1.039 · TTFT 2.074 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 72 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 91,92 tok/s TG Prefill 3.113 · TTFT 7.635 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 73 | Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,25 tok/s TG Prefill 8.339 · TTFT 298 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 74 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,43 tok/s TG Prefill 2.659 · TTFT 3.956 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 75 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,07 tok/s TG Prefill 2.389 · TTFT 4.453 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 76 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,96 tok/s TG Prefill 2.540 · TTFT 4.155 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 77 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,06 tok/s TG Prefill 2.421 · TTFT 9.812 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 78 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,01 tok/s TG Prefill 2.225 · TTFT 4.791 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 79 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,89 tok/s TG Prefill 2.246 · TTFT 4.750 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 80 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,45 tok/s TG Prefill 2.269 · TTFT 4.646 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 81 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,94 tok/s TG Prefill 6.450 · TTFT 379 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 82 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,53 tok/s TG Prefill 106 · TTFT 20.413 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 83 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,20 tok/s TG Prefill 1.745 · TTFT 6.003 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 84 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,91 tok/s TG Prefill 4.040 · TTFT 608 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 85 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,61 tok/s TG Prefill 1.738 · TTFT 1.111 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 86 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.653 · TTFT 1.169 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 87 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.461 · TTFT 1.321 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 88 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,50 tok/s TG Prefill 1.394 · TTFT 1.386 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 89 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,15 tok/s TG Prefill 1.375 · TTFT 1.403 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 90 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,01 tok/s TG Prefill 1.371 · TTFT 1.564 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 91 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,91 tok/s TG Prefill 1.421 · TTFT 1.356 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 92 | gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,07 tok/s TG Prefill 96 · TTFT 20.531 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 93 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,97 tok/s TG Prefill 1.121 · TTFT 1.720 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → |

