Mario Alka
@marioalka · Administrator · Member since 07/2026
Ich bin Unternehmer, Softwareentwickler und KI-Enthusiast. Seit vielen Jahren entwickle ich Unternehmenssoftware und beschäftige mich inzwischen fast täglich mit lokalen LLMs, KI-Agenten und leistungsfähiger KI-Hardware.
Mit LLM-Benchmark.de möchte ich eine Plattform schaffen, auf der Modelle, GPUs und Agenten objektiv und reproduzierbar miteinander verglichen werden.
4.976benchmarks contributed
4.911Performance runs
56Harness runs
106Models tested
21GPUs used
3.484Best throughput · tok/s
100,0%Best success rate
Hardware used
NVIDIA RTX A60001025× · 1.568 tok/sAMD Radeon AI PRO R9700978× · 667 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition589× · 2.144 tok/sAMD Radeon RX 7900 XTX361× · 718 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition307× · 2.414 tok/sAMD Radeon PRO W7900 Dual Slot241× · 344 tok/sNVIDIA GeForce RTX 5090226× · 2.491 tok/sNVIDIA GeForce RTX 5070 Ti222× · 1.744 tok/sNVIDIA GeForce RTX 3090 Ti222× · 1.493 tok/sAMD Radeon PRO W7800 48GB164× · 703 tok/sNVIDIA DGX SPARK (GB10)117× · 903 tok/sNVIDIA GeForce RTX 309098× · 3.484 tok/s
Models tested
Qwen3.6-35B-A3B207×gpt-oss-20b166×Qwen3-30B-A3B-Instruct-2507134×Qwen3-Coder-30B-A3B-Instruct132×Meta-Llama-3.1-8B-Instruct130×Qwen3-30B-A3B-Thinking-2507128×Laguna-XS-2.1127×Ministral-3-14B-Reasoning-2512126×Qwen3.5-35B-A3B113×Ornith-1.0-9B111×Devstral-Small-2-24B-Instruct-2512108×Qwen3-VL-30B-A3B-Instruct107×Qwen2.5-Coder-32B-Instruct104×Magistral-Small-2509102×
Top performance runs
| Model | Hardware | tok/s | TTFT | Date |
|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B 10× | NVIDIA GeForce RTX 3090 tensorfold | 3.484 | 14.388 ms | Oct 26, 2026 |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B 10× | NVIDIA GeForce RTX 3090 tensorfold | 2.867 | 17.054 ms | Oct 26, 2026 |
| gemma-4-E2B-it 10× | NVIDIA GeForce RTX 5090 llama.cpp | 2.491 | 4.382 ms | Jul 28, 2026 |
| gemma-4-E2B-it 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 2.414 | 4.107 ms | Jul 27, 2026 |
| gemma-4-E2B-it 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 2.412 | 4.107 ms | Oct 23, 2026 |
| NVIDIA-Nemotron-3-Nano-4B 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 2.183 | 5.598 ms | Jul 27, 2026 |
| NVIDIA-Nemotron-3-Nano-4B 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 2.144 | 5.598 ms | Oct 23, 2026 |
| gemma-4-E2B-it 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition llama.cpp | 2.144 | 4.819 ms | Jul 28, 2026 |
| gpt-oss-20b 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 1.995 | 5.309 ms | Jul 29, 2026 |
| gpt-oss-20b 10× | NVIDIA RTX PRO 6000 Blackwell Workstation Edition llama.cpp | 1.994 | 5.323 ms | Jul 28, 2026 |
Harness results
| Model | Hardware | Success rate | Points | Date |
|---|---|---|---|---|
| Qwen3.6-35B-A3B-AWQ | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 200/200 | Sep 29, 2026 |
| Jev-1.13.0 | 100,0% | 200/200 | Sep 29, 2026 | |
| Qwen3.6-35B-A3B-AWQ | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 200/200 | Sep 29, 2026 |
| Qwen3.8-27B-Uncensored | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 200/200 | Sep 29, 2026 |
| Open-Jev-27B-v1.1 | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 200/200 | Sep 29, 2026 |
| Qwen3.8-Flash-Next | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 100/100 | Oct 8, 2026 |
| Kolibri-1 | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 100,0% | 100/100 | Oct 8, 2026 |
| Kolibri-1 | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 98,6% | 207/210 | Oct 8, 2026 |
| Qwen3.8-Flash-Next | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 98,1% | 206/210 | Oct 8, 2026 |
| Qwen3.6-35B-A3B-AWQ | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | 96,5% | 193/200 | Sep 29, 2026 |

