⚡
Performance-Benchmark
Wie schnell ist das Modell?
Roher Durchsatz auf echter Hardware – wie viele Token ein Modell pro Sekunde erzeugt, wie schnell es den Prompt verarbeitet und wie kurz die Zeit bis zum ersten Token ausfällt. Je höher, desto besser.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 173,31 tok/s TG Prefill 1.741 · TTFT 11.668 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,94 tok/s TG Prefill 1.591 · TTFT 6.243 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,91 tok/s TG Prefill 1.759 · TTFT 13.043 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,22 tok/s TG Prefill 1.694 · TTFT 14.443 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,51 tok/s TG Prefill 1.276 · TTFT 8.623 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | Gemma-4-26B-A4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,50 tok/s TG Prefill 1.250 · TTFT 16.339 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 7 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 117,08 tok/s TG Prefill 1.052 · TTFT 9.431 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 115,77 tok/s TG Prefill 2.211 · TTFT 11.617 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Nemotron-Cascade-2-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 114,47 tok/s TG Prefill 1.071 · TTFT 9.340 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 10 | NVIDIA-Nemotron-3-Nano-4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 113,41 tok/s TG Prefill 1.704 · TTFT 5.805 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | Nemotron-3-Nano-Omni-30B-A3B-ReasoningNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,42 tok/s TG Prefill 955 · TTFT 10.320 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 12 | North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,87 tok/s TG Prefill 1.342 · TTFT 7.595 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 13 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,68 tok/s TG Prefill 1.483 · TTFT 15.115 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 14 | NVIDIA-Nemotron-3-Nano-4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,04 tok/s TG Prefill 2.341 · TTFT 9.556 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 15 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,55 tok/s TG Prefill 2.558 · TTFT 11.357 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 16 | Qwen-AgentWorld-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,82 tok/s TG Prefill 1.501 · TTFT 14.918 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,52 tok/s TG Prefill 1.402 · TTFT 15.961 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 18 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,16 tok/s TG Prefill 1.485 · TTFT 15.094 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,33 tok/s TG Prefill 1.951 · TTFT 6.387 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 20 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,19 tok/s TG Prefill 2.357 · TTFT 12.337 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Qwen-AgentWorld-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,67 tok/s TG Prefill 1.142 · TTFT 8.725 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 22 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,67 tok/s TG Prefill 1.129 · TTFT 8.832 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 23 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,40 tok/s TG Prefill 1.128 · TTFT 8.829 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 24 | Nemotron-3-Nano-Omni-30B-A3B-ReasoningNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,13 tok/s TG Prefill 1.379 · TTFT 16.184 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 25 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 97,78 tok/s TG Prefill 1.899 · TTFT 6.568 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 26 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 95,43 tok/s TG Prefill 1.761 · TTFT 7.081 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 27 | Gemma-4-26B-A4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 95,18 tok/s TG Prefill 1.121 · TTFT 8.844 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Nemotron-Cascade-2-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,63 tok/s TG Prefill 1.463 · TTFT 15.382 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 29 | Meta-Llama-3.1-8B-InstructMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,37 tok/s TG Prefill 2.658 · TTFT 10.905 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 30 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,87 tok/s TG Prefill 1.519 · TTFT 1.301 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Meta-Llama-3.1-8B-InstructMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,24 tok/s TG Prefill 1.951 · TTFT 6.429 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 32 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,78 tok/s TG Prefill 1.153 · TTFT 1.880 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 33 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,57 tok/s TG Prefill 1.207 · TTFT 1.796 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 34 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,56 tok/s TG Prefill 1.178 · TTFT 1.842 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,33 tok/s TG Prefill 1.093 · TTFT 1.983 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,26 tok/s TG Prefill 1.512 · TTFT 17.280 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 37 | NVIDIA-Nemotron-3-Nano-4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,55 tok/s TG Prefill 1.663 · TTFT 1.154 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 38 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,94 tok/s TG Prefill 1.028 · TTFT 1.867 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Nemotron-Cascade-2-30B-A3BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,95 tok/s TG Prefill 984 · TTFT 1.967 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Nemotron-3-Nano-Omni-30B-A3B-ReasoningNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,78 tok/s TG Prefill 1.009 · TTFT 1.903 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 41 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 56,83 tok/s TG Prefill 1.123 · TTFT 10.037 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 56,61 tok/s TG Prefill 1.179 · TTFT 1.676 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Qwen-AgentWorld-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,72 tok/s TG Prefill 1.018 · TTFT 1.900 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,70 tok/s TG Prefill 1.005 · TTFT 1.925 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,23 tok/s TG Prefill 1.000 · TTFT 1.934 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 46 | Gemma-4-26B-A4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,42 tok/s TG Prefill 1.141 · TTFT 1.734 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 47 | Seed-OSS-36B-InstructByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,99 tok/s TG Prefill 428 · TTFT 53.343 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 48 | Gemma-4-26B-A4B-itGoogle PerformancebenchmarkPerformancetest Small 1.0 | 42,22 tok/s TG Prefill 71 · TTFT 609 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 49 | Meta-Llama-3.1-8B-InstructMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,39 tok/s TG Prefill 1.237 · TTFT 1.773 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 50 | Gemma-4-26B-A4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,53 tok/s TG Prefill 282 · TTFT 6.994 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 51 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,63 tok/s TG Prefill 801 · TTFT 32.456 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 52 | Qwen3.6-27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,06 tok/s TG Prefill 536 · TTFT 41.917 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 53 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,17 tok/s TG Prefill 597 · TTFT 18.806 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 54 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,25 tok/s TG Prefill 939 · TTFT 14.944 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 55 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,03 tok/s TG Prefill 1.200 · TTFT 27.883 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 56 | Qwen3.6-27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,61 tok/s TG Prefill 401 · TTFT 24.934 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 57 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,83 tok/s TG Prefill 734 · TTFT 2.764 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 58 | Seed-OSS-36B-InstructByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,90 tok/s TG Prefill 321 · TTFT 31.739 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 59 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,57 tok/s TG Prefill 698 · TTFT 41.575 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 60 | OpenReasoning-Nemotron-32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,08 tok/s TG Prefill 515 · TTFT 24.159 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 61 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,64 tok/s TG Prefill 517 · TTFT 24.224 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 62 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,39 tok/s TG Prefill 518 · TTFT 24.247 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 63 | OpenReasoning-Nemotron-32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,53 tok/s TG Prefill 691 · TTFT 41.832 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 64 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,01 tok/s TG Prefill 699 · TTFT 41.624 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 65 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,88 tok/s TG Prefill 409 · TTFT 4.942 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 66 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,77 tok/s TG Prefill 410 · TTFT 5.067 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 67 | Llama-3_3-Nemotron-Super-49B-v1_5NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,26 tok/s TG Prefill 308 · TTFT 40.477 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 68 | Qwen3.6-27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,30 tok/s TG Prefill 361 · TTFT 5.366 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 69 | Llama-3_3-Nemotron-Super-49B-v1_5NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,02 tok/s TG Prefill 415 · TTFT 69.643 ms | 10× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 70 | Nemotron-H-47B-Reasoning-128KNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,66 tok/s TG Prefill 160 · TTFT 61.556 ms | 5× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 71 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,45 tok/s TG Prefill 336 · TTFT 6.524 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 72 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,45 tok/s TG Prefill 338 · TTFT 6.488 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 73 | OpenReasoning-Nemotron-32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,44 tok/s TG Prefill 342 · TTFT 6.343 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 74 | Seed-OSS-36B-InstructByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,63 tok/s TG Prefill 280 · TTFT 7.000 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 75 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkPerformancetest Small 1.0 | 8,88 tok/s TG Prefill 22 · TTFT 906 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 76 | Llama-3_3-Nemotron-Super-49B-v1_5NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,08 tok/s TG Prefill 194 · TTFT 11.241 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 77 | Nemotron-H-47B-Reasoning-128KNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,98 tok/s TG Prefill 159 · TTFT 12.016 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → |