Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

NVIDIA RTX A6000

NVIDIA48 GB VRAM
992Benchmarks
43Models
992Performance
0Harness
15 WIdle power
300 WMax power
Best generation
1.568,0 tok/s
gemma-4-E2B-it
∅ Generation
252,9 tok/s
Schnitt aus 992 Läufen
Best prefill
55.260 tok/s
Prompt processing
Best TTFT
117 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser GPU · 1.568,0 tok/s
Bester Prefill: 55.260 tok/s · 43 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf NVIDIA RTX A6000 – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
1.568,0 tok/s
Nemotron-3-Nano-4B4B
1.485,1 tok/s
Ornith-1.0-9B9B
1.062,5 tok/s
Meta-Llama-3.1-8B-Instruct8B
1.026,4 tok/s
Qwen3.5-35B-A3B35B
842,1 tok/s
Gemma-4-26B-A4B-it26B
841,8 tok/s
Laguna-XS-2.1
836,4 tok/s
Qwen3.6-35B-A3B35B
800,4 tok/s
Qwen-AgentWorld-35B-A3B35B
799,7 tok/s
Qwen3-Coder-30B-A3B-Instruct30B
789,2 tok/s
Anzeige
Performance profile

Durchsatz auf NVIDIA RTX A6000

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

1.9131.5051.0976892812.44315.11727.79140.465Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.568,0 tok/s Generation, 33.935 tok/s Prefill, TTFT 798 ms (8 Laufe)gemma-4-E2B-itNemotron-3-Nano-4B - 1.485,1 tok/s Generation, 33.698 tok/s Prefill, TTFT 805 ms (3 Laufe)Nemotron-3-Nano-4BOrnith-1.0-9B - 1.062,5 tok/s Generation, 18.369 tok/s Prefill, TTFT 1.318 ms (5 Laufe)Ornith-1.0-9BMeta-Llama-3.1-8B-Instruct - 1.026,4 tok/s Generation, 22.274 tok/s Prefill, TTFT 1.452 ms (4 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3.5-35B-A3B - 842,1 tok/s Generation, 21.017 tok/s Prefill, TTFT 5.093 ms (6 Laufe)Qwen3.5-35B-A3BGemma-4-26B-A4B-it - 841,8 tok/s Generation, 28.153 tok/s Prefill, TTFT 1.058 ms (4 Laufe)Gemma-4-26B-A4B-itLaguna-XS-2.1 - 836,4 tok/s Generation, 26.282 tok/s Prefill, TTFT 4.694 ms (7 Laufe)Laguna-XS-2.1Qwen3.6-35B-A3B - 800,4 tok/s Generation, 20.714 tok/s Prefill, TTFT 5.924 ms (6 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 799,7 tok/s Generation, 30.088 tok/s Prefill, TTFT 894 ms (2 Laufe)Qwen-AgentWorld-35B-A...Qwen3-Coder-30B-A3B-Instruct - 789,2 tok/s Generation, 28.705 tok/s Prefill, TTFT 2.367 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-VL-30B-A3B-Instruct - 763,5 tok/s Generation, 33.064 tok/s Prefill, TTFT 1.075 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Qwen3-30B-A3B-Instruct-2507 - 758,7 tok/s Generation, 32.254 tok/s Prefill, TTFT 1.091 ms (3 Laufe)Qwen3-30B-A3B-Instruc...Nemotron-3-Nano-30B-A3B - 756,7 tok/s Generation, 11.340 tok/s Prefill, TTFT 10.216 ms (3 Laufe)Nemotron-3-Nano-30B-A...Qwen3-30B-A3B-Thinking-2507 - 751,7 tok/s Generation, 31.426 tok/s Prefill, TTFT 1.213 ms (2 Laufe)Qwen3-30B-A3B-Thinkin...Ministral-3-14B-Reasoning-2512 - 735,1 tok/s Generation, 15.874 tok/s Prefill, TTFT 2.078 ms (2 Laufe)Ministral-3-14B-Reaso...Nemotron-Cascade-2-30B-A3B - 723,7 tok/s Generation, 11.365 tok/s Prefill, TTFT 10.330 ms (3 Laufe)Nemotron-Cascade-2-30...gpt-oss-20b - 703,8 tok/s Generation, 8.973 tok/s Prefill, TTFT 5.347 ms (4 Laufe)gpt-oss-20bgemma-4-12B-it - 681,8 tok/s Generation, 15.255 tok/s Prefill, TTFT 2.017 ms (2 Laufe)gemma-4-12B-itNorth-Mini-Code-1.0 - 648,5 tok/s Generation, 18.445 tok/s Prefill, TTFT 4.022 ms (4 Laufe)North-Mini-Code-1.0Qwen3-Coder-Next - 629,8 tok/s Generation, 24.446 tok/s Prefill, TTFT 1.439 ms (2 Laufe)Qwen3-Coder-NextOrnith-1.5-35B-A3B - 626,4 tok/s Generation, 16.135 tok/s Prefill, TTFT 4.286 ms (4 Laufe)Ornith-1.5-35B-A3B
gemma-4-E2B-it 1.568,0 tok/sNemotron-3-Nano-4B 1.485,1 tok/sOrnith-1.0-9B 1.062,5 tok/sMeta-Llama-3.1-8B-Instruct 1.026,4 tok/sQwen3.5-35B-A3B 842,1 tok/sGemma-4-26B-A4B-it 841,8 tok/sLaguna-XS-2.1 836,4 tok/sQwen3.6-35B-A3B 800,4 tok/sQwen-AgentWorld-35B-A3B 799,7 tok/sQwen3-Coder-30B-A3B-Instruct 789,2 tok/sQwen3-VL-30B-A3B-Instruct 763,5 tok/sQwen3-30B-A3B-Instruct-2507 758,7 tok/sNemotron-3-Nano-30B-A3B 756,7 tok/sQwen3-30B-A3B-Thinking-2507 751,7 tok/sMinistral-3-14B-Reasoning-2512 735,1 tok/sNemotron-Cascade-2-30B-A3B 723,7 tok/sgpt-oss-20b 703,8 tok/sgemma-4-12B-it 681,8 tok/sNorth-Mini-Code-1.0 648,5 tok/sQwen3-Coder-Next 629,8 tok/sOrnith-1.5-35B-A3B 626,4 tok/s

ENGnach Engine

1.8701.5371.2058735402.35112.94123.53134.121Prefill (tok/s)Generation (tok/s)vLLM - 1.568,0 tok/s Generation, 28.652 tok/s Prefill, TTFT 1.118 ms (59 Laufe)vLLMllama.cpp - 842,1 tok/s Generation, 7.820 tok/s Prefill, TTFT 9.756 ms (21 Laufe)llama.cpp
vLLM 1.568,0 tok/sllama.cpp 842,1 tok/s

CPUnach Prozessor

1.7251.6461.5681.4901.41121.79322.72023.64724.575Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 1.568,0 tok/s Generation, 23.184 tok/s Prefill, TTFT 3.385 ms (80 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 1.568,0 tok/s
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf NVIDIA RTX A6000.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.567,98 tok/s TG
Prefill 55.260 · TTFT 492 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
2Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.485,14 tok/s TG
Prefill 44.171 · TTFT 717 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
3gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.359,09 tok/s TG
Prefill 47.158 · TTFT 587 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
4gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,50 tok/s TG
Prefill 38.712 · TTFT 690 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
5Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.062,52 tok/s TG
Prefill 21.965 · TTFT 1.226 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
6Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.026,44 tok/s TG
Prefill 26.805 · TTFT 1.371 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
7gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
909,00 tok/s TG
Prefill 43.093 · TTFT 288 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
8Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
899,41 tok/s TG
Prefill 30.214 · TTFT 473 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
9Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
881,75 tok/s TG
Prefill 22.565 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
10Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
842,08 tok/s TG
Prefill 6.029 · TTFT 13.332 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
11Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
841,75 tok/s TG
Prefill 32.027 · TTFT 923 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
12Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
838,55 tok/s TG
Prefill 6.016 · TTFT 13.397 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
13Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
836,37 tok/s TG
Prefill 39.157 · TTFT 1.033 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
14Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
832,96 tok/s TG
Prefill 27.508 · TTFT 1.327 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
15Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
810,27 tok/s TG
Prefill 7.685 · TTFT 13.735 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
16Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
806,94 tok/s TG
Prefill 7.252 · TTFT 13.902 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
17gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
803,18 tok/s TG
Prefill 35.757 · TTFT 347 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
18Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
800,39 tok/s TG
Prefill 32.313 · TTFT 827 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
19Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
799,65 tok/s TG
Prefill 31.954 · TTFT 834 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
20Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
791,54 tok/s TG
Prefill 26.710 · TTFT 1.226 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
21Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
789,24 tok/s TG
Prefill 37.676 · TTFT 952 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
22Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
787,25 tok/s TG
Prefill 32.522 · TTFT 826 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
23Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
786,19 tok/s TG
Prefill 19.249 · TTFT 1.376 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
24Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
771,80 tok/s TG
Prefill 34.194 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
25Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
763,50 tok/s TG
Prefill 35.900 · TTFT 987 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
26Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
758,69 tok/s TG
Prefill 34.913 · TTFT 992 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
27Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
756,69 tok/s TG
Prefill 7.030 · TTFT 14.551 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
28Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
755,10 tok/s TG
Prefill 6.964 · TTFT 14.586 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
29Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
754,69 tok/s TG
Prefill 26.306 · TTFT 1.120 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
30Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
751,67 tok/s TG
Prefill 32.340 · TTFT 1.271 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
31Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
735,14 tok/s TG
Prefill 16.886 · TTFT 1.945 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
32Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
732,27 tok/s TG
Prefill 28.221 · TTFT 955 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
33Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
729,28 tok/s TG
Prefill 27.628 · TTFT 966 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
34Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
723,68 tok/s TG
Prefill 7.027 · TTFT 14.700 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
35Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
723,16 tok/s TG
Prefill 7.058 · TTFT 14.771 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
36Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
720,92 tok/s TG
Prefill 30.926 · TTFT 1.138 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
37Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
718,47 tok/s TG
Prefill 28.493 · TTFT 951 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
38Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
712,04 tok/s TG
Prefill 35.143 · TTFT 1.137 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
39gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
703,79 tok/s TG
Prefill 8.617 · TTFT 5.459 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
40Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
697,04 tok/s TG
Prefill 30.227 · TTFT 1.164 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
41Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
691,32 tok/s TG
Prefill 30.805 · TTFT 1.147 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
42Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
690,88 tok/s TG
Prefill 29.513 · TTFT 1.000 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
43gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
687,53 tok/s TG
Prefill 9.035 · TTFT 5.288 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
44gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
685,28 tok/s TG
Prefill 9.018 · TTFT 5.356 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
45gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
681,82 tok/s TG
Prefill 16.224 · TTFT 1.899 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
46gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
680,00 tok/s TG
Prefill 9.221 · TTFT 5.286 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
47Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
679,07 tok/s TG
Prefill 5.945 · TTFT 15.921 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
48Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
675,29 tok/s TG
Prefill 20.479 · TTFT 781 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
49Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
673,19 tok/s TG
Prefill 30.512 · TTFT 1.156 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
50Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
669,65 tok/s TG
Prefill 6.004 · TTFT 15.775 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
51gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
668,00 tok/s TG
Prefill 11.047 · TTFT 1.802 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
52Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
664,59 tok/s TG
Prefill 27.704 · TTFT 965 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
53Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
658,68 tok/s TG
Prefill 27.910 · TTFT 964 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
54Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
655,42 tok/s TG
Prefill 30.671 · TTFT 1.283 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
55Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
655,08 tok/s TG
Prefill 14.863 · TTFT 2.211 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
56North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
648,52 tok/s TG
Prefill 29.491 · TTFT 1.310 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
57Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
647,82 tok/s TG
Prefill 16.265 · TTFT 725 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
58gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
631,69 tok/s TG
Prefill 29.259 · TTFT 405 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
59Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
630,94 tok/s TG
Prefill 24.767 · TTFT 1.191 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
60Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
629,83 tok/s TG
Prefill 26.016 · TTFT 1.347 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
61Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
626,41 tok/s TG
Prefill 28.681 · TTFT 928 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
62Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
622,29 tok/s TG
Prefill 24.690 · TTFT 1.093 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
63Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
611,40 tok/s TG
Prefill 11.799 · TTFT 2.083 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
64gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
610,99 tok/s TG
Prefill 14.285 · TTFT 2.134 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
65Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
610,90 tok/s TG
Prefill 25.129 · TTFT 1.087 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
66Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
603,66 tok/s TG
Prefill 5.250 · TTFT 7.504 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
67Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
600,91 tok/s TG
Prefill 5.037 · TTFT 7.660 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
68gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
600,60 tok/s TG
Prefill 11.197 · TTFT 1.774 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
69North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
598,90 tok/s TG
Prefill 30.083 · TTFT 948 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
70Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
593,67 tok/s TG
Prefill 14.572 · TTFT 6.256 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
71Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
592,35 tok/s TG
Prefill 20.010 · TTFT 1.519 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
72North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
592,34 tok/s TG
Prefill 6.822 · TTFT 6.994 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
73North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
589,57 tok/s TG
Prefill 7.384 · TTFT 6.836 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
74Ornith-1.5-35B-A3B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
588,56 tok/s TG
Prefill 25.569 · TTFT 1.053 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
75Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
588,46 tok/s TG
Prefill 20.028 · TTFT 1.512 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
76Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
587,94 tok/s TG
Prefill 22.877 · TTFT 1.531 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
77Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
582,71 tok/s TG
Prefill 31.647 · TTFT 1.123 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
78Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
580,46 tok/s TG
Prefill 29.873 · TTFT 587 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
79Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
576,78 tok/s TG
Prefill 14.305 · TTFT 2.330 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
80Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
573,56 tok/s TG
Prefill 31.043 · TTFT 1.133 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA RTX A6000.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – NVIDIA RTX A6000

HerstellerNVIDIA
ArchitekturAmpere
VRAM48 GB
Tensor-Recheneinheiten336
Speicherbandbreite768 GB/s
TDP300 W
PCIe4.0
Release10/2020
Best generation1.568,0 tok/s
Best prefill55.260 tok/s
Models43
Messläufe (Performance)992