🧠
Processor
AMD Ryzen 9 8945HX with Radeon Graphics
AMD
Best generation
901,9 tok/s
Qwen3-30B-A3B-Instruct-2507
∅ Generation
389,1 tok/s
Schnitt aus 184 Läufen
Best prefill
17.357 tok/s
Prompt processing
Best TTFT
245 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Qwen3-30B-A3B-Instruct-2507 läuft am schnellsten auf dieser CPU · 901,9 tok/s
Bester Prefill: 17.357 tok/s · 14 Modelle getestet
Bester Prefill: 17.357 tok/s · 14 Modelle getestet
Top models
Bester gemessener Durchsatz je Modell auf AMD Ryzen 9 8945HX with Radeon Graphics – umschaltbar nach Generation, Prefill oder Kombiwert.
Performance profile
Durchsatz auf AMD Ryzen 9 8945HX with Radeon Graphics
Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.
MODnach Modell
Qwen3-30B-A3B-Instruct-2507 901,9 tok/sQwen3-30B-A3B-Thinking-2507 883,7 tok/sgpt-oss-20b 797,2 tok/sQwen3-Coder-30B-A3B-Instruct 670,7 tok/sMinistral-3-14B-Reasoning-2512 524,4 tok/sQwen3-VL-30B-A3B-Instruct 475,8 tok/sCodestral-22B-v0.1 475,6 tok/sMagistral-Small-2509 474,0 tok/sDevstral-Small-2-24B-Instruct-2512 473,2 tok/sQwen2.5-Coder-32B-Instruct 472,9 tok/sQwen3.6-35B-A3B 472,7 tok/sQwen3.5-35B-A3B 472,6 tok/sMistral-Small-3.1-24B-Instruct-2503 472,5 tok/sDevstral-Small-2507 471,8 tok/s
ENGnach Engine
vLLM 901,9 tok/sllama.cpp 475,8 tok/s
GPUnach Grafikkarte
NVIDIA GeForce RTX 3090 Ti 901,9 tok/s
Throughput & latency
In the leaderboard →Performancebenchmark
80 veroeffentlichte Performance-Läufe auf AMD Ryzen 9 8945HX with Radeon Graphics.
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 901,86 tok/s TG Prefill 12.965 · TTFT 12.663 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 2 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 883,71 tok/s TG Prefill 12.981 · TTFT 12.917 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 3 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 797,18 tok/s TG Prefill 11.820 · TTFT 1.789 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 4 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 796,82 tok/s TG Prefill 11.892 · TTFT 1.781 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 5 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 670,65 tok/s TG Prefill 17.357 · TTFT 3.808 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 6 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 524,37 tok/s TG Prefill 7.751 · TTFT 4.130 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 7 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 496,79 tok/s TG Prefill 12.291 · TTFT 3.700 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 8 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 487,24 tok/s TG Prefill 12.271 · TTFT 3.758 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 9 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 483,69 tok/s TG Prefill 9.270 · TTFT 1.070 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 10 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 479,47 tok/s TG Prefill 9.242 · TTFT 1.075 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 11 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 475,79 tok/s TG Prefill 6.572 · TTFT 3.089 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 12 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 475,57 tok/s TG Prefill 6.613 · TTFT 3.068 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 13 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 475,30 tok/s TG Prefill 5.812 · TTFT 1.707 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 14 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 475,27 tok/s TG Prefill 5.800 · TTFT 1.710 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 15 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 475,00 tok/s TG Prefill 6.609 · TTFT 3.072 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 16 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 474,73 tok/s TG Prefill 6.600 · TTFT 3.079 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 17 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 473,98 tok/s TG Prefill 6.595 · TTFT 3.077 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 18 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 473,82 tok/s TG Prefill 6.434 · TTFT 3.151 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 19 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 473,19 tok/s TG Prefill 6.576 · TTFT 3.084 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 20 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,98 tok/s TG Prefill 6.576 · TTFT 3.088 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 21 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,92 tok/s TG Prefill 6.577 · TTFT 3.088 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 22 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,71 tok/s TG Prefill 6.385 · TTFT 3.174 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 23 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,68 tok/s TG Prefill 6.583 · TTFT 3.083 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 24 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,64 tok/s TG Prefill 6.577 · TTFT 3.084 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 25 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,60 tok/s TG Prefill 6.592 · TTFT 3.075 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 26 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,56 tok/s TG Prefill 6.399 · TTFT 3.168 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 27 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,49 tok/s TG Prefill 6.605 · TTFT 3.073 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 28 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,43 tok/s TG Prefill 6.543 · TTFT 3.103 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 29 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 472,07 tok/s TG Prefill 6.589 · TTFT 3.082 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 30 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,98 tok/s TG Prefill 6.570 · TTFT 3.090 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 31 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,78 tok/s TG Prefill 6.446 · TTFT 3.147 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 32 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,61 tok/s TG Prefill 6.627 · TTFT 3.065 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 33 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,34 tok/s TG Prefill 6.588 · TTFT 3.081 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 34 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,33 tok/s TG Prefill 6.562 · TTFT 3.094 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 35 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,28 tok/s TG Prefill 6.424 · TTFT 3.156 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 36 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,13 tok/s TG Prefill 6.578 · TTFT 3.087 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 37 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,05 tok/s TG Prefill 6.622 · TTFT 3.068 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 38 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 471,04 tok/s TG Prefill 6.575 · TTFT 3.091 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 39 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 470,76 tok/s TG Prefill 6.586 · TTFT 3.084 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 40 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 470,37 tok/s TG Prefill 6.608 · TTFT 3.073 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 41 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 470,21 tok/s TG Prefill 6.615 · TTFT 3.070 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 42 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 470,17 tok/s TG Prefill 6.563 · TTFT 3.093 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 43 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,97 tok/s TG Prefill 6.570 · TTFT 3.091 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 44 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,85 tok/s TG Prefill 6.585 · TTFT 3.083 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 45 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,71 tok/s TG Prefill 6.608 · TTFT 3.074 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 46 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,66 tok/s TG Prefill 6.577 · TTFT 3.088 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 47 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,48 tok/s TG Prefill 6.637 · TTFT 3.060 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 48 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,28 tok/s TG Prefill 6.551 · TTFT 3.099 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 49 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,17 tok/s TG Prefill 6.594 · TTFT 3.080 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 50 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,04 tok/s TG Prefill 6.560 · TTFT 3.097 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 51 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 469,00 tok/s TG Prefill 6.592 · TTFT 3.081 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 52 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,75 tok/s TG Prefill 6.561 · TTFT 3.092 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 53 | gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,74 tok/s TG Prefill 6.617 · TTFT 3.069 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 54 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,63 tok/s TG Prefill 6.589 · TTFT 3.082 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 55 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,55 tok/s TG Prefill 6.408 · TTFT 3.163 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 56 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,50 tok/s TG Prefill 6.586 · TTFT 3.084 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 57 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,28 tok/s TG Prefill 6.578 · TTFT 3.088 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 58 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,11 tok/s TG Prefill 6.601 · TTFT 3.076 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 59 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 467,60 tok/s TG Prefill 6.583 · TTFT 3.085 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 60 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 467,27 tok/s TG Prefill 6.597 · TTFT 3.078 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 61 | Devstral-Small-2-24B-Instruct-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 467,25 tok/s TG Prefill 5.842 · TTFT 1.697 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 62 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,81 tok/s TG Prefill 6.592 · TTFT 3.077 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 63 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,68 tok/s TG Prefill 6.574 · TTFT 3.087 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 64 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,43 tok/s TG Prefill 6.563 · TTFT 3.094 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 65 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,39 tok/s TG Prefill 6.589 · TTFT 3.082 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 66 | Codestral-22B-v0.1Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,20 tok/s TG Prefill 6.545 · TTFT 3.103 ms | 10× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 67 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,08 tok/s TG Prefill 5.852 · TTFT 1.695 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 68 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 466,05 tok/s TG Prefill 5.832 · TTFT 1.702 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 69 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,84 tok/s TG Prefill 5.890 · TTFT 1.687 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 70 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,47 tok/s TG Prefill 6.034 · TTFT 1.639 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 71 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,11 tok/s TG Prefill 5.888 · TTFT 1.687 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 72 | Magistral-Small-2509Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,82 tok/s TG Prefill 5.915 · TTFT 1.680 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 73 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,66 tok/s TG Prefill 5.853 · TTFT 1.697 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 74 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,61 tok/s TG Prefill 5.872 · TTFT 1.691 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 75 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,60 tok/s TG Prefill 5.893 · TTFT 1.685 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 76 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,49 tok/s TG Prefill 5.883 · TTFT 1.687 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 77 | Devstral-Small-2507Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,40 tok/s TG Prefill 5.886 · TTFT 1.688 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 78 | Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,36 tok/s TG Prefill 5.894 · TTFT 1.686 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 79 | Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,09 tok/s TG Prefill 5.846 · TTFT 1.696 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 80 | Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 464,00 tok/s TG Prefill 5.830 · TTFT 1.703 ms | 5× | NVIDIA GeForce RTX 3090 Ti32x AMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → |
Agent & chat rating
In the leaderboard →Harnessbenchmark
0 veroeffentlichte Harness-Läufe auf AMD Ryzen 9 8945HX with Radeon Graphics.
Noch keine Harnessbenchmarks auf dieser Hardware.