🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 317,00 tok/s TG Prefill 14.849 · TTFT 2.492 ms | 10× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 2 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,35 tok/s TG Prefill 11.565 · TTFT 1.219 ms | 5× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 3 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,39 tok/s TG Prefill 5.909 · TTFT 412 ms | 1× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAM | vLLMgodclaw | Details → | |
| 4 | Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,25 tok/s TG Prefill 8.339 · TTFT 298 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 5 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 356,01 tok/s TG Prefill 10.663 · TTFT 3.085 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 6 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,39 tok/s TG Prefill 7.898 · TTFT 1.797 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 7 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,91 tok/s TG Prefill 4.040 · TTFT 608 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 8 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 385,85 tok/s TG Prefill 16.933 · TTFT 1.925 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 9 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 223,20 tok/s TG Prefill 12.589 · TTFT 1.123 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 10 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,94 tok/s TG Prefill 6.450 · TTFT 379 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 11 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,94 tok/s TG Prefill 3.492 · TTFT 6.829 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 12 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,96 tok/s TG Prefill 2.540 · TTFT 4.155 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 13 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.653 · TTFT 1.169 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 14 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,01 tok/s TG Prefill 3.668 · TTFT 6.469 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 15 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,43 tok/s TG Prefill 2.659 · TTFT 3.956 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 16 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,61 tok/s TG Prefill 1.738 · TTFT 1.111 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 17 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,22 tok/s TG Prefill 3.297 · TTFT 7.376 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 18 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,07 tok/s TG Prefill 2.389 · TTFT 4.453 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 19 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,58 tok/s TG Prefill 1.461 · TTFT 1.321 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 20 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,99 tok/s TG Prefill 3.096 · TTFT 7.876 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 21 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,89 tok/s TG Prefill 2.246 · TTFT 4.750 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 22 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,15 tok/s TG Prefill 1.375 · TTFT 1.403 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 23 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,41 tok/s TG Prefill 3.120 · TTFT 7.835 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 24 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,01 tok/s TG Prefill 2.225 · TTFT 4.791 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 25 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,50 tok/s TG Prefill 1.394 · TTFT 1.386 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 26 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 91,92 tok/s TG Prefill 3.113 · TTFT 7.635 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 27 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,45 tok/s TG Prefill 2.269 · TTFT 4.646 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 28 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,91 tok/s TG Prefill 1.421 · TTFT 1.356 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 29 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,01 tok/s TG Prefill 1.371 · TTFT 1.564 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1AWQ | Details → | |
| 30 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,06 tok/s TG Prefill 2.421 · TTFT 9.812 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 31 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,20 tok/s TG Prefill 1.745 · TTFT 6.003 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 32 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,97 tok/s TG Prefill 1.121 · TTFT 1.720 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 33 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 725,25 tok/s TG Prefill 16.303 · TTFT 1.813 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 34 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,72 tok/s TG Prefill 12.079 · TTFT 1.048 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 35 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,66 tok/s TG Prefill 6.076 · TTFT 355 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 36 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 709,02 tok/s TG Prefill 16.443 · TTFT 1.805 ms | 10× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 37 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 462,42 tok/s TG Prefill 11.388 · TTFT 1.082 ms | 5× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 38 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,38 tok/s TG Prefill 5.434 · TTFT 411 ms | 1× | NVIDIA GeForce RTX 3090AMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 39 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkKurzaufgaben TTFT - Thinking OFF - Outputlimit 1/5/10 V1 | 218,77 tok/s TG Prefill - · TTFT 54 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw 0.27.1NVFP4 W4A16 | Details → | |
| 40 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 697,38 tok/s TG Prefill 14.373 · TTFT 1.721 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 41 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 417,52 tok/s TG Prefill 12.747 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 42 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 127,28 tok/s TG Prefill 8.225 · TTFT 296 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 43 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 615,23 tok/s TG Prefill 13.720 · TTFT 797 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 44 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 709,24 tok/s TG Prefill 11.744 · TTFT 2.430 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 45 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 728,31 tok/s TG Prefill 10.081 · TTFT 2.619 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 46 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 884,45 tok/s TG Prefill 33.614 · TTFT 1.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 47 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 913,32 tok/s TG Prefill 38.043 · TTFT 1.193 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 48 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 954,95 tok/s TG Prefill 31.797 · TTFT 1.633 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 49 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.060,15 tok/s TG Prefill 33.319 · TTFT 976 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclawAWQ | Details → | |
| 50 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.425,74 tok/s TG Prefill 35.639 · TTFT 560 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMgodclaw | Details → | |
| 51 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 418,77 tok/s TG Prefill 17.642 · TTFT 1.399 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 52 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 584,06 tok/s TG Prefill 25.276 · TTFT 1.075 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 53 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 274,09 tok/s TG Prefill 15.257 · TTFT 775 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 54 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 358,28 tok/s TG Prefill 20.534 · TTFT 617 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 55 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,14 tok/s TG Prefill 7.814 · TTFT 243 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 56 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 96,74 tok/s TG Prefill 9.683 · TTFT 204 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 57 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,84 tok/s TG Prefill 3.760 · TTFT 5.878 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 58 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,14 tok/s TG Prefill 3.027 · TTFT 3.561 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 59 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,44 tok/s TG Prefill 1.717 · TTFT 1.294 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 60 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.562,27 tok/s TG Prefill 2.593 · TTFT 34.854 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 61 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 795,03 tok/s TG Prefill 2.378 · TTFT 15.951 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 62 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,32 tok/s TG Prefill 1.225 · TTFT 2.121 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 63 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,39 tok/s TG Prefill 3.269 · TTFT 6.004 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 64 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,45 tok/s TG Prefill 2.547 · TTFT 3.826 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 65 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,26 tok/s TG Prefill 1.798 · TTFT 1.074 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 66 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 833,03 tok/s TG Prefill - · TTFT 213 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 67 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 490,51 tok/s TG Prefill - · TTFT 177 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 68 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,86 tok/s TG Prefill - · TTFT 155 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 69 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 283 Pkt 91,3% · 283/310 Aufg. · 2.384,4 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0NVFP4 | Details → | |
| 70 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 119 Pkt 38,4% · 119/310 Aufg. · 87,9 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0NVFP4 | Details → | |
| 71 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 902,92 tok/s TG Prefill - · TTFT 227 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 72 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 297 Pkt 95,8% · 297/310 Aufg. · 2.578,6 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 73 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 626,30 tok/s TG Prefill - · TTFT 165 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 74 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,47 tok/s TG Prefill - · TTFT 98 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 75 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 289 Pkt 93,2% · 289/310 Aufg. · 2.504,7 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0FP8 | Details → | |
| 76 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 164 Pkt 52,9% · 164/310 Aufg. · 208,4 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 77 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 115 Pkt 37,1% · 115/310 Aufg. · 99,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0FP8 | Details → | |
| 78 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 424,23 tok/s TG Prefill - · TTFT 1.608 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 79 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 302,61 tok/s TG Prefill - · TTFT 612 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 80 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,21 tok/s TG Prefill - · TTFT 344 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 81 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 846,62 tok/s TG Prefill - · TTFT 238 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 82 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 569,97 tok/s TG Prefill - · TTFT 160 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 83 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,71 tok/s TG Prefill - · TTFT 160 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 84 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 207 Pkt 98,6% · 207/210 Aufg. · 1.080,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 0.29.0FP8 | Details → | |
| 85 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 108 Pkt 51,4% · 108/210 Aufg. · 72,1 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 0.29.0FP8 | Details → | |
| 86 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 411,27 tok/s TG Prefill - · TTFT 2.092 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 87 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 257,18 tok/s TG Prefill - · TTFT 3.386 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 88 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,23 tok/s TG Prefill - · TTFT 590 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 89 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 206 Pkt 98,1% · 206/210 Aufg. · 1.001,2 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic210NVFP4 | Details → | |
| 90 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 145 Pkt 69,0% · 145/210 Aufg. · 145,4 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic210NVFP4 | Details → | |
| 91 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 388,05 tok/s TG Prefill 16.198 · TTFT 2.053 ms | 10× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | vLLMgodclawINT4 | Details → | |
| 92 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 343,90 tok/s TG Prefill 9.629 · TTFT 1.973 ms | 5× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | vLLMgodclawINT4 | Details → | |
| 93 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,60 tok/s TG Prefill 4.438 · TTFT 606 ms | 1× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | vLLMgodclawINT4 | Details → | |
| 94 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 57,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMBuzzwordTrainAWQ | Details → | |
| 95 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 107 Pkt 53,5% · 107/200 Aufg. · 38,9 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 96 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 110 Pkt 55,0% · 110/200 Aufg. · 28,7 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 97 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 101 Pkt 50,5% · 101/200 Aufg. · 36,8 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 98 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 193 Pkt 96,5% · 193/200 Aufg. · 3.667,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 99 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 87 Pkt 43,5% · 87/200 Aufg. · 19,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 100 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 36,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 101 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Harness benchmarkDecision-Benchmark V 1.0 | 159 Pkt 79,5% · 159/200 Aufg. · 35,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 102 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 29,9 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 103 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Harness benchmarkDecision-Benchmark V 1.0 | 159 Pkt 79,5% · 159/200 Aufg. · 21,0 s | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMvllmAWQ | Details → | |
| 104 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 178,53 tok/s TG Prefill 3.756 · TTFT 10.700 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 105 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,45 tok/s TG Prefill 2.962 · TTFT 5.639 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 106 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,09 tok/s TG Prefill 1.399 · TTFT 1.755 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 107 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 531,74 tok/s TG Prefill 44.141 · TTFT 1.002 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 108 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 338,72 tok/s TG Prefill 33.135 · TTFT 574 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 109 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,05 tok/s TG Prefill 13.702 · TTFT 223 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 110 | Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 301,98 tok/s TG Prefill 19.406 · TTFT 1.945 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 111 | Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,39 tok/s TG Prefill 14.992 · TTFT 1.125 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 112 | Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,32 tok/s TG Prefill 6.700 · TTFT 380 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 113 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 322,89 tok/s TG Prefill 27.208 · TTFT 972 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 114 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,26 tok/s TG Prefill 21.013 · TTFT 558 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 115 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,77 tok/s TG Prefill 8.388 · TTFT 218 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 116 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 404,99 tok/s TG Prefill 14.538 · TTFT 2.823 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 117 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 279,01 tok/s TG Prefill 11.575 · TTFT 1.408 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 118 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,55 tok/s TG Prefill 5.171 · TTFT 476 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 119 | Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,73 tok/s TG Prefill 23.398 · TTFT 1.915 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 120 | Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,54 tok/s TG Prefill 19.091 · TTFT 830 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 121 | Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,35 tok/s TG Prefill 8.149 · TTFT 302 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 122 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 717,61 tok/s TG Prefill 52.503 · TTFT 1.022 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 123 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 479,20 tok/s TG Prefill 40.760 · TTFT 356 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 124 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,26 tok/s TG Prefill 15.904 · TTFT 156 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 125 | Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 320,40 tok/s TG Prefill 19.188 · TTFT 3.026 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 126 | Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 221,06 tok/s TG Prefill 15.907 · TTFT 999 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 127 | Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,44 tok/s TG Prefill 6.967 · TTFT 349 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 128 | Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 387,65 tok/s TG Prefill 32.764 · TTFT 2.280 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 129 | Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 252,00 tok/s TG Prefill 26.134 · TTFT 576 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 130 | Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 55,89 tok/s TG Prefill 10.932 · TTFT 223 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 131 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 384,19 tok/s TG Prefill 49.306 · TTFT 1.939 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 132 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 260,24 tok/s TG Prefill 38.946 · TTFT 372 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 133 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,53 tok/s TG Prefill 14.803 · TTFT 166 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 134 | Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 355,86 tok/s TG Prefill 24.866 · TTFT 2.634 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 135 | Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 253,98 tok/s TG Prefill 19.902 · TTFT 780 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 136 | Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,34 tok/s TG Prefill 7.155 · TTFT 346 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 137 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,60 tok/s TG Prefill 1.882 · TTFT 2.287 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 138 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 96,90 tok/s TG Prefill 3.268 · TTFT 1.317 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 139 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,30 tok/s TG Prefill 11.550 · TTFT 373 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 140 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 179,02 tok/s TG Prefill 3.915 · TTFT 10.290 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 141 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,17 tok/s TG Prefill 3.097 · TTFT 5.385 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 142 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,97 tok/s TG Prefill 1.455 · TTFT 1.686 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclawAWQ | Details → | |
| 143 | Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 280,80 tok/s TG Prefill 8.760 · TTFT 5.247 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 144 | Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 198,18 tok/s TG Prefill 7.101 · TTFT 2.296 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 145 | Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,22 tok/s TG Prefill 3.257 · TTFT 748 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 146 | Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 315,16 tok/s TG Prefill 13.007 · TTFT 3.960 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 147 | Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 224,00 tok/s TG Prefill 10.578 · TTFT 1.518 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 148 | Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,36 tok/s TG Prefill 4.818 · TTFT 505 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 149 | Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 442,02 tok/s TG Prefill 16.333 · TTFT 3.286 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 150 | Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 326,73 tok/s TG Prefill 13.426 · TTFT 1.202 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 151 | Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,23 tok/s TG Prefill 5.975 · TTFT 411 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 152 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 95,00 tok/s TG Prefill 470 · TTFT 155 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 153 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,00 tok/s TG Prefill - · TTFT 0 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 123 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 154 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,72 tok/s TG Prefill 21.352 · TTFT 2.183 ms | 10× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 155 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 254,69 tok/s TG Prefill 14.644 · TTFT 1.771 ms | 5× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 156 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,50 tok/s TG Prefill 7.717 · TTFT 319 ms | 1× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 157 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 503,33 tok/s TG Prefill 112.346 · TTFT 242 ms | 10× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 158 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 258,23 tok/s TG Prefill 81.661 · TTFT 159 ms | 5× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 159 | Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,80 tok/s TG Prefill 20.717 · TTFT 121 ms | 1× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 160 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,75 tok/s TG Prefill 987 · TTFT 26.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 161 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,94 tok/s TG Prefill 762 · TTFT 15.666 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 162 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,01 tok/s TG Prefill 441 · TTFT 4.837 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 163 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.100,69 tok/s TG Prefill 27.110 · TTFT 739 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 164 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 608,35 tok/s TG Prefill 23.343 · TTFT 414 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 165 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,73 tok/s TG Prefill 15.397 · TTFT 126 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 166 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 861,40 tok/s TG Prefill 15.615 · TTFT 1.677 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 167 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 543,78 tok/s TG Prefill 12.359 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 168 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 126,12 tok/s TG Prefill 7.867 · TTFT 251 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 169 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,96 tok/s TG Prefill 3.010 · TTFT 18.082 ms | 10× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 170 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,88 tok/s TG Prefill 2.387 · TTFT 7.059 ms | 5× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 171 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,51 tok/s TG Prefill 1.097 · TTFT 2.256 ms | 1× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 172 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 201,02 tok/s TG Prefill 13.392 · TTFT 2.808 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 173 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,19 tok/s TG Prefill 9.219 · TTFT 1.374 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 174 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,59 tok/s TG Prefill 2.033 · TTFT 986 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 175 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,64 tok/s TG Prefill 13.127 · TTFT 2.817 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 176 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,10 tok/s TG Prefill 10.048 · TTFT 1.358 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 177 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,09 tok/s TG Prefill 2.094 · TTFT 943 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 178 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,65 tok/s TG Prefill 1.849 · TTFT 17.975 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 179 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,88 tok/s TG Prefill 1.520 · TTFT 10.032 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 180 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,65 tok/s TG Prefill 702 · TTFT 3.160 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 181 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,80 tok/s TG Prefill 2.181 · TTFT 17.048 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 182 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,94 tok/s TG Prefill 1.472 · TTFT 9.827 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 183 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,26 tok/s TG Prefill 856 · TTFT 2.877 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 184 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,89 tok/s TG Prefill 2.286 · TTFT 17.114 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 185 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,93 tok/s TG Prefill 1.679 · TTFT 9.606 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 186 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,29 tok/s TG Prefill 858 · TTFT 2.871 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 187 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,01 tok/s TG Prefill 6.125 · TTFT 5.956 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 188 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,42 tok/s TG Prefill 5.042 · TTFT 3.214 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 189 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,72 tok/s TG Prefill 2.235 · TTFT 1.090 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 190 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 289,48 tok/s TG Prefill 11.717 · TTFT 3.710 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 191 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 178,74 tok/s TG Prefill 9.274 · TTFT 1.816 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 192 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,42 tok/s TG Prefill 4.105 · TTFT 597 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 193 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,30 tok/s TG Prefill 4.368 · TTFT 9.029 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 194 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,24 tok/s TG Prefill 3.416 · TTFT 5.086 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 195 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,00 tok/s TG Prefill 1.583 · TTFT 1.597 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 196 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 262,93 tok/s TG Prefill 8.472 · TTFT 4.535 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 197 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,19 tok/s TG Prefill 6.653 · TTFT 2.534 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 198 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,53 tok/s TG Prefill 2.874 · TTFT 857 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 199 | Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 626,41 tok/s TG Prefill 28.681 · TTFT 928 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 200 | Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 418,21 tok/s TG Prefill 21.951 · TTFT 535 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 201 | Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,55 tok/s TG Prefill 8.176 · TTFT 245 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 202 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 514,52 tok/s TG Prefill 22.477 · TTFT 1.541 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 203 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 365,08 tok/s TG Prefill 17.147 · TTFT 895 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 204 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,76 tok/s TG Prefill 6.990 · TTFT 350 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 205 | Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 356,42 tok/s TG Prefill 16.357 · TTFT 2.480 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 206 | Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 250,44 tok/s TG Prefill 13.079 · TTFT 1.402 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 207 | Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,52 tok/s TG Prefill 5.943 · TTFT 462 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 208 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 95,47 tok/s TG Prefill 3.802 · TTFT 14.501 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 209 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,67 tok/s TG Prefill 2.956 · TTFT 8.171 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 210 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,11 tok/s TG Prefill 1.404 · TTFT 2.484 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 211 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 276,46 tok/s TG Prefill 11.804 · TTFT 2.833 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 212 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 197,32 tok/s TG Prefill 9.348 · TTFT 1.552 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 213 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,64 tok/s TG Prefill 3.471 · TTFT 630 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 214 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 197,25 tok/s TG Prefill 5.040 · TTFT 7.497 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 215 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 111,56 tok/s TG Prefill 3.912 · TTFT 4.256 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 216 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,25 tok/s TG Prefill 1.890 · TTFT 1.299 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 217 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 629,83 tok/s TG Prefill 26.016 · TTFT 1.347 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 218 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 410,37 tok/s TG Prefill 19.698 · TTFT 777 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 219 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 133,13 tok/s TG Prefill 8.147 · TTFT 302 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 220 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 248,32 tok/s TG Prefill 6.596 · TTFT 4.963 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 221 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,08 tok/s TG Prefill 5.398 · TTFT 2.776 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 222 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,16 tok/s TG Prefill 2.495 · TTFT 886 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 223 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 658,68 tok/s TG Prefill 27.910 · TTFT 964 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 224 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 450,20 tok/s TG Prefill 21.244 · TTFT 558 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 225 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 172,47 tok/s TG Prefill 8.214 · TTFT 241 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 226 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 664,59 tok/s TG Prefill 27.704 · TTFT 965 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 227 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 453,61 tok/s TG Prefill 21.156 · TTFT 557 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 228 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 172,52 tok/s TG Prefill 8.354 · TTFT 237 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 229 | Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 712,04 tok/s TG Prefill 35.143 · TTFT 1.137 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 230 | Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 462,23 tok/s TG Prefill 24.899 · TTFT 645 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 231 | Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 147,92 tok/s TG Prefill 11.709 · TTFT 234 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 232 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 236,03 tok/s TG Prefill 5.472 · TTFT 5.845 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 233 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,75 tok/s TG Prefill 4.220 · TTFT 3.249 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 234 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,84 tok/s TG Prefill 1.988 · TTFT 997 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 235 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 262,60 tok/s TG Prefill 7.019 · TTFT 5.005 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 236 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,33 tok/s TG Prefill 5.312 · TTFT 2.861 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 237 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,99 tok/s TG Prefill 2.848 · TTFT 865 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 238 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 515,26 tok/s TG Prefill 31.910 · TTFT 1.107 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 239 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 367,00 tok/s TG Prefill 24.948 · TTFT 625 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 240 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,20 tok/s TG Prefill 10.821 · TTFT 225 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 241 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 251,07 tok/s TG Prefill 7.025 · TTFT 4.495 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 242 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,19 tok/s TG Prefill 5.535 · TTFT 2.477 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 243 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,87 tok/s TG Prefill 2.641 · TTFT 751 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 244 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 547,72 tok/s TG Prefill 30.727 · TTFT 1.142 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 245 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 386,05 tok/s TG Prefill 23.773 · TTFT 648 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 246 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 161,14 tok/s TG Prefill 10.675 · TTFT 228 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 247 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 536,72 tok/s TG Prefill 9.810 · TTFT 3.224 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 248 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 329,05 tok/s TG Prefill 8.161 · TTFT 1.778 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 249 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,96 tok/s TG Prefill 3.773 · TTFT 568 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 250 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 534,84 tok/s TG Prefill 10.455 · TTFT 3.204 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → |

