🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 697,38 tok/s TG Prefill 14.373 · TTFT 1.721 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 2 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 417,52 tok/s TG Prefill 12.747 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 3 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 127,28 tok/s TG Prefill 8.225 · TTFT 296 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 4 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 418,77 tok/s TG Prefill 17.642 · TTFT 1.399 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 5 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 274,09 tok/s TG Prefill 15.257 · TTFT 775 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 6 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,14 tok/s TG Prefill 7.814 · TTFT 243 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 5 5600X 6-Core Processor · 96 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 7 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.562,27 tok/s TG Prefill 2.593 · TTFT 34.854 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 8 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 795,03 tok/s TG Prefill 2.378 · TTFT 15.951 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 9 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,32 tok/s TG Prefill 1.225 · TTFT 2.121 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 10 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.555,31 tok/s TG Prefill 2.655 · TTFT 34.751 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 11 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 804,23 tok/s TG Prefill 2.435 · TTFT 15.796 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 12 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,58 tok/s TG Prefill 1.951 · TTFT 1.010 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 13 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.564,61 tok/s TG Prefill 2.600 · TTFT 34.894 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 14 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 783,55 tok/s TG Prefill 2.459 · TTFT 15.907 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 15 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,06 tok/s TG Prefill 1.772 · TTFT 1.128 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 16 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 1.044,38 tok/s TG Prefill 38.866 · TTFT 388 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 17 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 589,64 tok/s TG Prefill 43.711 · TTFT 223 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 18 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 133,13 tok/s TG Prefill 20.590 · TTFT 106 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 19 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkOffice Agentic Work 100 - Tool Usage V1 | 100 Pkt 100,0% · 100/100 Aufg. · 751,6 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | officeagentic100NVFP4 | Details → | |
| 20 | Kolibri-178.1BAleph Alpha Harness benchmarkOffice Agentic Work 100 - Tool Usage V1 | 100 Pkt 100,0% · 100/100 Aufg. · 547,7 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | officeagentic100NVFP4 | Details → | |
| 21 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 833,03 tok/s TG Prefill - · TTFT 213 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 22 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 490,51 tok/s TG Prefill - · TTFT 177 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 23 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,86 tok/s TG Prefill - · TTFT 155 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0NVFP4 | Details → | |
| 24 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 283 Pkt 91,3% · 283/310 Aufg. · 2.384,4 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0NVFP4 | Details → | |
| 25 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 119 Pkt 38,4% · 119/310 Aufg. · 87,9 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0NVFP4 | Details → | |
| 26 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 902,92 tok/s TG Prefill - · TTFT 227 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 27 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 297 Pkt 95,8% · 297/310 Aufg. · 2.578,6 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 28 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 626,30 tok/s TG Prefill - · TTFT 165 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 29 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,47 tok/s TG Prefill - · TTFT 98 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0FP8 | Details → | |
| 30 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 289 Pkt 93,2% · 289/310 Aufg. · 2.504,7 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0FP8 | Details → | |
| 31 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 164 Pkt 52,9% · 164/310 Aufg. · 208,4 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 32 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 115 Pkt 37,1% · 115/310 Aufg. · 99,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310 0.29.0FP8 | Details → | |
| 33 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 424,23 tok/s TG Prefill - · TTFT 1.608 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 34 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 302,61 tok/s TG Prefill - · TTFT 612 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 35 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,21 tok/s TG Prefill - · TTFT 344 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 36 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 846,62 tok/s TG Prefill - · TTFT 238 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 37 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 569,97 tok/s TG Prefill - · TTFT 160 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 38 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,71 tok/s TG Prefill - · TTFT 160 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw 0.29.0 | Details → | |
| 39 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 207 Pkt 98,6% · 207/210 Aufg. · 1.080,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 0.29.0FP8 | Details → | |
| 40 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 108 Pkt 51,4% · 108/210 Aufg. · 72,1 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 0.29.0FP8 | Details → | |
| 41 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 411,27 tok/s TG Prefill - · TTFT 2.092 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 42 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 257,18 tok/s TG Prefill - · TTFT 3.386 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 43 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,23 tok/s TG Prefill - · TTFT 590 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMcodex_cliNVFP4 | Details → | |
| 44 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 206 Pkt 98,1% · 206/210 Aufg. · 1.001,2 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic210NVFP4 | Details → | |
| 45 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 145 Pkt 69,0% · 145/210 Aufg. · 145,4 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMdeterministic210NVFP4 | Details → | |
| 46 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 57,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMBuzzwordTrainAWQ | Details → | |
| 47 | Qwen3.8-Flash-Next180BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 107 Pkt 53,5% · 107/200 Aufg. · 38,9 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 48 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 110 Pkt 55,0% · 110/200 Aufg. · 28,7 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 49 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 101 Pkt 50,5% · 101/200 Aufg. · 36,8 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 50 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 193 Pkt 96,5% · 193/200 Aufg. · 3.667,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 51 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 87 Pkt 43,5% · 87/200 Aufg. · 19,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 52 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 36,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 53 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Harness benchmarkDecision-Benchmark V 1.0 | 159 Pkt 79,5% · 159/200 Aufg. · 35,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 54 | Laya0.4BConvai Innovations Harness benchmarkDecision-Benchmark V 1.0 | 122 Pkt 61,0% · 122/200 Aufg. · 14,1 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | pytorchpytorch | Details → | |
| 55 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 29,9 s | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMvllmNVFP4 | Details → | |
| 56 | Open-Jev-27B-v1.127BZefan Cai / Open-Jev Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 75,5 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | pytorchpytorchBF16 | Details → | |
| 57 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,60 tok/s TG Prefill 1.882 · TTFT 2.287 ms | 10× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 58 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 96,90 tok/s TG Prefill 3.268 · TTFT 1.317 ms | 5× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 59 | Qwen3.8-27B-Uncensored27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,30 tok/s TG Prefill 11.550 · TTFT 373 ms | 1× | 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 60 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,75 tok/s TG Prefill 987 · TTFT 26.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 61 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,94 tok/s TG Prefill 762 · TTFT 15.666 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 62 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,01 tok/s TG Prefill 441 · TTFT 4.837 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 63 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.100,69 tok/s TG Prefill 27.110 · TTFT 739 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 64 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 608,35 tok/s TG Prefill 23.343 · TTFT 414 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 65 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,73 tok/s TG Prefill 15.397 · TTFT 126 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 66 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 861,40 tok/s TG Prefill 15.615 · TTFT 1.677 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 67 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 543,78 tok/s TG Prefill 12.359 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 68 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 126,12 tok/s TG Prefill 7.867 · TTFT 251 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 69 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 774,90 tok/s TG Prefill 3.820 · TTFT 15.880 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 70 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 429,63 tok/s TG Prefill 3.334 · TTFT 6.284 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 71 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,13 tok/s TG Prefill 2.928 · TTFT 938 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 72 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 774,10 tok/s TG Prefill 3.866 · TTFT 16.399 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 73 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 437,16 tok/s TG Prefill 3.329 · TTFT 6.298 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 74 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,22 tok/s TG Prefill 2.941 · TTFT 933 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 75 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 697,82 tok/s TG Prefill 2.814 · TTFT 19.437 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 76 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 413,18 tok/s TG Prefill 2.358 · TTFT 8.016 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 77 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 133,97 tok/s TG Prefill 2.205 · TTFT 1.246 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 78 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 762,72 tok/s TG Prefill 4.616 · TTFT 15.283 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 79 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 440,78 tok/s TG Prefill 3.886 · TTFT 5.752 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 80 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 777,69 tok/s TG Prefill 3.903 · TTFT 16.458 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 81 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 434,94 tok/s TG Prefill 3.365 · TTFT 6.267 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 82 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 706,85 tok/s TG Prefill 2.752 · TTFT 19.766 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 83 | Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 405,17 tok/s TG Prefill 2.414 · TTFT 7.850 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawINT4 | Details → | |
| 84 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 123,54 tok/s TG Prefill 2.199 · TTFT 79.387 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 85 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,40 tok/s TG Prefill 1.968 · TTFT 23.096 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 86 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,55 tok/s TG Prefill 1.165 · TTFT 1.835 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 87 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,08 tok/s TG Prefill 1.589 · TTFT 83.232 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 88 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,74 tok/s TG Prefill 1.649 · TTFT 24.427 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 89 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,50 tok/s TG Prefill 980 · TTFT 2.182 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 90 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 95,87 tok/s TG Prefill 1.165 · TTFT 108.105 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 91 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,80 tok/s TG Prefill 1.092 · TTFT 32.891 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 92 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,83 tok/s TG Prefill 699 · TTFT 3.073 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 93 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 548,62 tok/s TG Prefill 4.931 · TTFT 20.370 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 94 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 312,31 tok/s TG Prefill 4.491 · TTFT 6.623 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 95 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,58 tok/s TG Prefill 2.290 · TTFT 1.014 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 96 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 530,51 tok/s TG Prefill 4.240 · TTFT 21.543 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 97 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 305,98 tok/s TG Prefill 3.962 · TTFT 7.171 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 98 | MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,80 tok/s TG Prefill 1.953 · TTFT 1.180 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 99 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 423,26 tok/s TG Prefill 2.897 · TTFT 27.048 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 100 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 238,46 tok/s TG Prefill 2.760 · TTFT 8.787 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 101 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,17 tok/s TG Prefill 1.587 · TTFT 1.411 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 102 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 423,38 tok/s TG Prefill 2.668 · TTFT 27.534 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 103 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 238,33 tok/s TG Prefill 2.465 · TTFT 9.171 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 104 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,06 tok/s TG Prefill 1.359 · TTFT 1.804 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 105 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 564,60 tok/s TG Prefill 3.577 · TTFT 19.963 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 106 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 308,32 tok/s TG Prefill 3.271 · TTFT 6.567 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 107 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,28 tok/s TG Prefill 2.209 · TTFT 883 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 108 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 557,10 tok/s TG Prefill 3.042 · TTFT 20.906 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 109 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 307,65 tok/s TG Prefill 2.768 · TTFT 7.045 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 110 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,61 tok/s TG Prefill 2.040 · TTFT 951 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 111 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 423,31 tok/s TG Prefill 2.911 · TTFT 27.041 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 112 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 236,07 tok/s TG Prefill 2.719 · TTFT 8.878 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 113 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,68 tok/s TG Prefill 1.767 · TTFT 1.224 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 114 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 422,61 tok/s TG Prefill 2.701 · TTFT 27.527 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 115 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,98 tok/s TG Prefill 2.469 · TTFT 9.177 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 116 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,77 tok/s TG Prefill 1.759 · TTFT 1.226 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 117 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 549,60 tok/s TG Prefill 3.637 · TTFT 19.950 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 118 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 308,96 tok/s TG Prefill 3.279 · TTFT 6.536 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 119 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,54 tok/s TG Prefill 2.245 · TTFT 862 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 120 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 561,09 tok/s TG Prefill 2.997 · TTFT 20.809 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 121 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 307,99 tok/s TG Prefill 2.795 · TTFT 7.017 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 122 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,91 tok/s TG Prefill 2.025 · TTFT 954 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ8 | Details → | |
| 123 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 203,47 tok/s TG Prefill 963 · TTFT 58.166 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 124 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 118,40 tok/s TG Prefill 1.007 · TTFT 19.503 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 125 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,23 tok/s TG Prefill 756 · TTFT 2.908 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 126 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.398,38 tok/s TG Prefill 8.247 · TTFT 8.094 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 127 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 762,10 tok/s TG Prefill 7.476 · TTFT 2.681 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 128 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,43 tok/s TG Prefill 4.807 · TTFT 401 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 129 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 334,72 tok/s TG Prefill 2.246 · TTFT 36.915 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 130 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,49 tok/s TG Prefill 2.071 · TTFT 12.702 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 131 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,38 tok/s TG Prefill 1.555 · TTFT 1.746 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 132 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 334,41 tok/s TG Prefill 2.100 · TTFT 37.421 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 133 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,66 tok/s TG Prefill 2.017 · TTFT 12.849 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 134 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,48 tok/s TG Prefill 1.516 · TTFT 1.792 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 135 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 382,08 tok/s TG Prefill 2.421 · TTFT 30.058 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 136 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,88 tok/s TG Prefill 2.064 · TTFT 10.570 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 137 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,03 tok/s TG Prefill 1.664 · TTFT 1.377 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 138 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 385,91 tok/s TG Prefill 2.350 · TTFT 30.012 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 139 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 206,50 tok/s TG Prefill 2.080 · TTFT 10.489 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 140 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,33 tok/s TG Prefill 1.735 · TTFT 1.320 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 141 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,08 tok/s TG Prefill 1.013 · TTFT 161.953 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 142 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,07 tok/s TG Prefill 958 · TTFT 47.870 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 143 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,40 tok/s TG Prefill 644 · TTFT 3.793 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 144 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,28 tok/s TG Prefill 761 · TTFT 168.314 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 145 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,63 tok/s TG Prefill 812 · TTFT 50.633 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 146 | Llama-3_1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,40 tok/s TG Prefill 547 · TTFT 4.475 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 147 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 203,75 tok/s TG Prefill 3.332 · TTFT 47.827 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 148 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,05 tok/s TG Prefill 3.476 · TTFT 13.786 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 149 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,55 tok/s TG Prefill 2.137 · TTFT 1.149 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 150 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,24 tok/s TG Prefill 2.746 · TTFT 49.827 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 151 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,63 tok/s TG Prefill 2.633 · TTFT 14.998 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 152 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,44 tok/s TG Prefill 1.610 · TTFT 1.524 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 153 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,46 tok/s TG Prefill 1.711 · TTFT 62.671 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 154 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,86 tok/s TG Prefill 1.631 · TTFT 19.862 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 155 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,49 tok/s TG Prefill 1.149 · TTFT 2.146 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 156 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 291,20 tok/s TG Prefill 2.971 · TTFT 34.561 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 157 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,68 tok/s TG Prefill 2.983 · TTFT 10.578 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 158 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,26 tok/s TG Prefill 2.396 · TTFT 1.025 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 159 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 302,99 tok/s TG Prefill 2.480 · TTFT 36.311 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 160 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,21 tok/s TG Prefill 2.237 · TTFT 11.826 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 161 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,78 tok/s TG Prefill 2.079 · TTFT 1.179 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 162 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 249,27 tok/s TG Prefill 1.839 · TTFT 45.580 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 163 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,58 tok/s TG Prefill 1.677 · TTFT 15.124 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 164 | Llama-3_3-Nemotron-Super-49B-v1_549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,31 tok/s TG Prefill 1.618 · TTFT 1.513 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 165 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,82 tok/s TG Prefill 750 · TTFT 2.935 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 166 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 200,61 tok/s TG Prefill 1.005 · TTFT 54.811 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 167 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 113,48 tok/s TG Prefill 978 · TTFT 18.052 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 168 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,51 tok/s TG Prefill 942 · TTFT 2.274 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 169 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 167,22 tok/s TG Prefill 896 · TTFT 65.273 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 170 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,03 tok/s TG Prefill 811 · TTFT 23.516 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 171 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,15 tok/s TG Prefill 809 · TTFT 2.652 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 172 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 365,25 tok/s TG Prefill 4.623 · TTFT 26.204 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 173 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 203,80 tok/s TG Prefill 4.269 · TTFT 7.822 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 174 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 56,80 tok/s TG Prefill 3.264 · TTFT 676 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 175 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 383,93 tok/s TG Prefill 3.677 · TTFT 27.389 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 176 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,50 tok/s TG Prefill 3.460 · TTFT 8.377 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 177 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,05 tok/s TG Prefill 3.016 · TTFT 729 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 178 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 321,91 tok/s TG Prefill 2.363 · TTFT 34.311 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 179 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,76 tok/s TG Prefill 2.154 · TTFT 11.118 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 180 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,53 tok/s TG Prefill 1.915 · TTFT 1.155 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 181 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.799,41 tok/s TG Prefill 9.192 · TTFT 8.876 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 182 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 762,69 tok/s TG Prefill 8.704 · TTFT 2.484 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 183 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 264,61 tok/s TG Prefill 5.077 · TTFT 385 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 184 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.447,27 tok/s TG Prefill 8.138 · TTFT 7.915 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 185 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 780,58 tok/s TG Prefill 7.221 · TTFT 2.850 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 186 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 240,47 tok/s TG Prefill 5.000 · TTFT 386 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 187 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.400,99 tok/s TG Prefill 6.038 · TTFT 8.703 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 188 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 794,89 tok/s TG Prefill 5.470 · TTFT 3.060 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 189 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 266,28 tok/s TG Prefill 4.441 · TTFT 434 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 190 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.367,32 tok/s TG Prefill 9.899 · TTFT 8.047 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 191 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 745,03 tok/s TG Prefill 8.908 · TTFT 2.564 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 192 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 243,43 tok/s TG Prefill 5.614 · TTFT 346 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 193 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.341,33 tok/s TG Prefill 8.440 · TTFT 8.344 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 194 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 654,42 tok/s TG Prefill 7.610 · TTFT 2.746 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 195 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 228,74 tok/s TG Prefill 2.392 · TTFT 977 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 196 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.212,13 tok/s TG Prefill 6.225 · TTFT 8.915 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 197 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 716,74 tok/s TG Prefill 4.374 · TTFT 3.675 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 198 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 223,05 tok/s TG Prefill 4.431 · TTFT 435 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 199 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.361,67 tok/s TG Prefill 9.538 · TTFT 7.854 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 200 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 753,03 tok/s TG Prefill 8.746 · TTFT 2.522 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 201 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 207,52 tok/s TG Prefill 5.470 · TTFT 354 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 202 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.389,23 tok/s TG Prefill 7.940 · TTFT 8.056 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 203 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 724,87 tok/s TG Prefill 7.439 · TTFT 2.684 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 204 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.243,85 tok/s TG Prefill 5.117 · TTFT 9.159 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 205 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 728,82 tok/s TG Prefill 6.326 · TTFT 3.026 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 206 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,86 tok/s TG Prefill 4.467 · TTFT 432 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 207 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.363,39 tok/s TG Prefill 9.248 · TTFT 8.137 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 208 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 727,21 tok/s TG Prefill 8.572 · TTFT 2.616 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 209 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 247,58 tok/s TG Prefill 4.770 · TTFT 407 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 210 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.338,40 tok/s TG Prefill 8.627 · TTFT 8.328 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 211 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 739,54 tok/s TG Prefill 7.791 · TTFT 2.713 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 212 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 244,27 tok/s TG Prefill 5.467 · TTFT 353 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 213 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.348,63 tok/s TG Prefill 6.479 · TTFT 8.949 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 214 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 739,97 tok/s TG Prefill 5.761 · TTFT 3.093 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 215 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 217,99 tok/s TG Prefill 4.689 · TTFT 412 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 216 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 412,83 tok/s TG Prefill 6.968 · TTFT 24.214 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 217 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 218,33 tok/s TG Prefill 6.144 · TTFT 7.137 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 218 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,51 tok/s TG Prefill 3.003 · TTFT 870 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 219 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 404,40 tok/s TG Prefill 6.093 · TTFT 25.028 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 220 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 217,39 tok/s TG Prefill 5.705 · TTFT 7.309 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 221 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,60 tok/s TG Prefill 2.989 · TTFT 822 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 222 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 342,04 tok/s TG Prefill 3.606 · TTFT 31.087 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 223 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 179,05 tok/s TG Prefill 3.577 · TTFT 9.635 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 224 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,14 tok/s TG Prefill 2.196 · TTFT 1.120 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 225 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 412,58 tok/s TG Prefill 6.480 · TTFT 24.413 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 226 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 219,09 tok/s TG Prefill 6.838 · TTFT 6.933 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 227 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,51 tok/s TG Prefill 3.434 · TTFT 718 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 228 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 406,23 tok/s TG Prefill 5.348 · TTFT 25.223 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 229 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 213,98 tok/s TG Prefill 5.838 · TTFT 7.294 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 230 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,99 tok/s TG Prefill 3.625 · TTFT 681 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 231 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 343,00 tok/s TG Prefill 3.698 · TTFT 31.024 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 232 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,11 tok/s TG Prefill 3.409 · TTFT 8.759 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 233 | Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,21 tok/s TG Prefill 2.441 · TTFT 1.008 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawAWQ | Details → | |
| 234 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 334,40 tok/s TG Prefill 2.260 · TTFT 36.888 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 235 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,27 tok/s TG Prefill 2.011 · TTFT 12.859 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 236 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 321,42 tok/s TG Prefill 2.147 · TTFT 37.376 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 237 | Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 186,37 tok/s TG Prefill 1.992 · TTFT 12.967 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 238 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 411,74 tok/s TG Prefill 6.821 · TTFT 24.282 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 239 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 219,61 tok/s TG Prefill 6.206 · TTFT 7.079 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 240 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,56 tok/s TG Prefill 3.452 · TTFT 709 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 241 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 391,83 tok/s TG Prefill 5.175 · TTFT 25.101 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 242 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 217,53 tok/s TG Prefill 5.226 · TTFT 7.446 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 243 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,59 tok/s TG Prefill 2.641 · TTFT 930 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 244 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 342,61 tok/s TG Prefill 3.592 · TTFT 31.111 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 245 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 182,02 tok/s TG Prefill 3.427 · TTFT 9.736 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 246 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,37 tok/s TG Prefill 2.309 · TTFT 1.056 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 247 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.309,27 tok/s TG Prefill 10.749 · TTFT 7.401 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 248 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 723,83 tok/s TG Prefill 9.782 · TTFT 2.438 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 249 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,69 tok/s TG Prefill 5.251 · TTFT 367 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 250 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.349,73 tok/s TG Prefill 11.193 · TTFT 7.579 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → |

