Created bymario-alka.dePowered bynoob2claw.detricoma.de
NVIDIA

NVIDIA-Nemotron-3-Super-120B-A12B120B

Benchmark profile and published results.

MoE120B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation600,9 tok/s
Min 0,0Ø 245,7Max 3.484,3
Ueber dem Durchschnitt · 4971 Systeme im Feld
Prefill2.911 tok/s
Min 4Ø 4.892Max 112.346
Unter dem Durchschnitt · 4953 Systeme im Feld
Time to First Token600 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

7805853901950,009641.9272.891Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 600,9 tok/s Generation, 837 tok/s Prefill, TTFT 73.953 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 423,4 tok/s Generation, 2.339 tok/s Prefill, TTFT 12.569 ms (12 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon AI PRO R9700 - 80,5 tok/s Generation, 436 tok/s Prefill, TTFT 102.716 ms (17 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 5070 Ti - 32,6 tok/s Generation, 88 tok/s Prefill, TTFT 156.105 ms (6 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 18,9 tok/s Generation, 106 tok/s Prefill, TTFT 171.396 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA DGX SPARK (GB10) - 11,4 tok/s Generation, 1.495 tok/s Prefill, TTFT 1.449 ms (1 Lauf)NVIDIA DGX SPARK (GB1...AMD Radeon RX 7900 XTX - 6,1 tok/s Generation, 67 tok/s Prefill, TTFT 166.452 ms (3 Laufe)AMD Radeon RX 7900 XTXNVIDIA GeForce RTX 5090 - 5,5 tok/s Generation, 49 tok/s Prefill, TTFT 150.808 ms (8 Laufe)NVIDIA GeForce RTX 50...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 600,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 423,4 tok/sAMD Radeon AI PRO R9700 80,5 tok/sNVIDIA GeForce RTX 5070 Ti 32,6 tok/sNVIDIA GeForce RTX 3090 Ti 18,9 tok/sNVIDIA DGX SPARK (GB10) 11,4 tok/sAMD Radeon RX 7900 XTX 6,1 tok/sNVIDIA GeForce RTX 5090 5,5 tok/s

CPUby processor

7805853901950,009641.9272.891Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 600,9 tok/s Generation, 837 tok/s Prefill, TTFT 73.953 ms (9 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 423,4 tok/s Generation, 2.339 tok/s Prefill, TTFT 12.569 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 80,5 tok/s Generation, 436 tok/s Prefill, TTFT 102.716 ms (17 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 32,6 tok/s Generation, 88 tok/s Prefill, TTFT 156.105 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 18,9 tok/s Generation, 106 tok/s Prefill, TTFT 171.396 ms (3 Laufe)AMD Ryzen 9 8945HX wi...NVIDIA Grace - 11,4 tok/s Generation, 1.495 tok/s Prefill, TTFT 1.449 ms (1 Lauf)NVIDIA GraceIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 6,1 tok/s Generation, 67 tok/s Prefill, TTFT 166.452 ms (3 Laufe)Intel(R) Xeon(R) CPU ...AMD Ryzen 7 5800X3D 8-Core Processor - 5,5 tok/s Generation, 49 tok/s Prefill, TTFT 150.808 ms (8 Laufe)AMD Ryzen 7 5800X3D 8...
AMD Ryzen 9 9950X 16-Core Processor 600,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 423,4 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 80,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 32,6 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 18,9 tok/sNVIDIA Grace 11,4 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 6,1 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 5,5 tok/s

ENGby engine

7795843891950,05459351.3261.716Prefill (tok/s)Generation (tok/s)llama.cpp - 600,9 tok/s Generation, 766 tok/s Prefill, TTFT 98.607 ms (58 Laufe)llama.cppvLLM - 11,4 tok/s Generation, 1.495 tok/s Prefill, TTFT 1.449 ms (1 Lauf)vLLM
llama.cpp 600,9 tok/svLLM 11,4 tok/s
Throughput & latency

Performance benchmark

Metric:
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
600,88 tok/s TG
Prefill 2.709 · TTFT 21.268 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
423,38 tok/s TG
Prefill 2.668 · TTFT 27.534 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
3NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
423,31 tok/s TG
Prefill 2.911 · TTFT 27.041 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
4NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
423,26 tok/s TG
Prefill 2.897 · TTFT 27.048 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
5NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
422,61 tok/s TG
Prefill 2.701 · TTFT 27.527 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
6NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
348,02 tok/s TG
Prefill 2.385 · TTFT 7.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
7NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
238,46 tok/s TG
Prefill 2.760 · TTFT 8.787 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
8NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
238,33 tok/s TG
Prefill 2.465 · TTFT 9.171 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
9NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,98 tok/s TG
Prefill 2.469 · TTFT 9.177 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
10NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
236,07 tok/s TG
Prefill 2.719 · TTFT 8.878 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
11NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
129,00 tok/s TG
Prefill 1.909 · TTFT 1.129 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
12NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,17 tok/s TG
Prefill 1.587 · TTFT 1.411 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
13NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,06 tok/s TG
Prefill 1.359 · TTFT 1.804 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0
14NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
86,77 tok/s TG
Prefill 1.759 · TTFT 1.226 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
15NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
86,68 tok/s TG
Prefill 1.767 · TTFT 1.224 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8
16NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,54 tok/s TG
Prefill 1.417 · TTFT 3.615 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_M
17NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
69,35 tok/s TG
Prefill 1.423 · TTFT 1.799 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_M
18NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,26 tok/s TG
Prefill 1.009 · TTFT 2.135 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
19NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,55 tok/s TG
Prefill 853 · TTFT 600 ms
1×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_M
20NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,59 tok/s TG
Prefill 122 · TTFT 237.566 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
21NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,79 tok/s TG
Prefill 109 · TTFT 133.175 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
22NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,17 tok/s TG
Prefill 851 · TTFT 2.528 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
23NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,86 tok/s TG
Prefill 805 · TTFT 2.387 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
24NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,15 tok/s TG
Prefill 74 · TTFT 191.503 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
25NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,04 tok/s TG
Prefill 74 · TTFT 191.933 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
26NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,99 tok/s TG
Prefill 74 · TTFT 191.470 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
27NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,28 tok/s TG
Prefill 85 · TTFT 331.062 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
28NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,26 tok/s TG
Prefill 85 · TTFT 330.872 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
29NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,82 tok/s TG
Prefill 85 · TTFT 331.365 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
30NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,17 tok/s TG
Prefill 211 · TTFT 47.089 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
31NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
18,86 tok/s TG
Prefill 117 · TTFT 322.251 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
32NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,81 tok/s TG
Prefill 67 · TTFT 215.255 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
33NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,07 tok/s TG
Prefill 104 · TTFT 170.078 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
34NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,60 tok/s TG
Prefill 71 · TTFT 293.317 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
35NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,79 tok/s TG
Prefill 187 · TTFT 10.300 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
36NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,19 tok/s TG
Prefill 96 · TTFT 191.977 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
37NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,14 tok/s TG
Prefill 93 · TTFT 194.178 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
38NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,12 tok/s TG
Prefill 98 · TTFT 21.966 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
39NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,39 tok/s TG
Prefill 1.495 · TTFT 1.449 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
40NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,96 tok/s TG
Prefill 61 · TTFT 35.263 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,93 tok/s TG
Prefill 61 · TTFT 35.078 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
42NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,93 tok/s TG
Prefill 58 · TTFT 37.175 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
43NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,36 tok/s TG
Prefill 90 · TTFT 96.800 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
44NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,90 tok/s TG
Prefill 88 · TTFT 98.810 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
45NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,87 tok/s TG
Prefill 61 · TTFT 35.354 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
46NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,67 tok/s TG
Prefill 99 · TTFT 21.860 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
47NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,11 tok/s TG
Prefill 50 · TTFT 45.015 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
48NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,03 tok/s TG
Prefill 58 · TTFT 186.063 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
49NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,54 tok/s TG
Prefill 62 · TTFT 139.871 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
50NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,41 tok/s TG
Prefill 62 · TTFT 140.359 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
51NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,07 tok/s TG
Prefill 78 · TTFT 27.484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8
52NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,91 tok/s TG
Prefill 82 · TTFT 26.277 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0
53NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,01 tok/s TG
Prefill 93 · TTFT 268.279 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
54NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,66 tok/s TG
Prefill 62 · TTFT 34.936 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
55NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,48 tok/s TG
Prefill 42 · TTFT 207.107 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0
56NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,42 tok/s TG
Prefill 41 · TTFT 212.358 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0
57NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,25 tok/s TG
Prefill 37 · TTFT 57.803 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0
58NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,16 tok/s TG
Prefill 42 · TTFT 207.388 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0
59NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,93 tok/s TG
Prefill 42 · TTFT 206.643 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.