Created bymario-alka.dePowered bynoob2claw.detricoma.de
NVIDIA

NVIDIA-Nemotron-3-Nano-4B4B

Benchmarkprofil und veröffentlichte Ergebnisse.

Dense4B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation2.182,7 tok/s
Min 0,0Ø 245,7Max 3.484,3
Ueber dem Durchschnitt · 4971 Systeme im Feld
Prefill44.171 tok/s
Min 4Ø 4.892Max 112.346
Ueber dem Durchschnitt · 4953 Systeme im Feld
Time to First Token159 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

2.8262.1201.4137070,005.92211.84517.767Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 2.182,7 tok/s Generation, 8.676 tok/s Prefill, TTFT 3.163 ms (5 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.937,7 tok/s Generation, 7.627 tok/s Prefill, TTFT 3.077 ms (12 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 1.878,7 tok/s Generation, 5.348 tok/s Prefill, TTFT 3.511 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX A6000 - 1.485,1 tok/s Generation, 14.412 tok/s Prefill, TTFT 1.383 ms (12 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 5070 Ti - 1.197,0 tok/s Generation, 4.606 tok/s Prefill, TTFT 4.936 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 992,1 tok/s Generation, 5.129 tok/s Prefill, TTFT 5.537 ms (3 Laufe)NVIDIA GeForce RTX 30...AMD Radeon AI PRO R9700 - 667,0 tok/s Generation, 3.749 tok/s Prefill, TTFT 6.361 ms (13 Laufe)AMD Radeon AI PRO R97...NVIDIA DGX SPARK (GB10) - 367,8 tok/s Generation, 2.933 tok/s Prefill, TTFT 13.303 ms (6 Laufe)NVIDIA DGX SPARK (GB1...NVIDIA GeForce RTX 2060 - 125,7 tok/s Generation, 1.395 tok/s Prefill, TTFT 8.754 ms (9 Laufe)NVIDIA GeForce RTX 20...CPU-only - 56,2 tok/s Generation, 576 tok/s Prefill, TTFT 70.732 ms (6 Laufe)CPU-only
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 2.182,7 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.937,7 tok/sNVIDIA GeForce RTX 5090 1.878,7 tok/sNVIDIA RTX A6000 1.485,1 tok/sNVIDIA GeForce RTX 5070 Ti 1.197,0 tok/sNVIDIA GeForce RTX 3090 Ti 992,1 tok/sAMD Radeon AI PRO R9700 667,0 tok/sNVIDIA DGX SPARK (GB10) 367,8 tok/sNVIDIA GeForce RTX 2060 125,7 tok/sCPU-only 56,2 tok/s

CPUnach Prozessor

2.8362.1271.4187090,003.9937.98611.979Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 2.182,7 tok/s Generation, 8.013 tok/s Prefill, TTFT 2.717 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 5 5600X 6-Core Processor - 2.144,3 tok/s Generation, 9.670 tok/s Prefill, TTFT 3.831 ms (2 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 1.937,7 tok/s Generation, 7.627 tok/s Prefill, TTFT 3.077 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 7 5800X3D 8-Core Processor - 1.878,7 tok/s Generation, 5.348 tok/s Prefill, TTFT 3.511 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 1.485,1 tok/s Generation, 9.606 tok/s Prefill, TTFT 4.063 ms (22 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 1.197,0 tok/s Generation, 4.606 tok/s Prefill, TTFT 4.936 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 992,1 tok/s Generation, 5.129 tok/s Prefill, TTFT 5.537 ms (3 Laufe)AMD Ryzen 9 8945HX wi...NVIDIA Grace - 367,8 tok/s Generation, 2.933 tok/s Prefill, TTFT 13.303 ms (6 Laufe)NVIDIA GraceAMD Ryzen 3 3100 4-Core Processor - 344,9 tok/s Generation, 3.449 tok/s Prefill, TTFT 3.300 ms (3 Laufe)AMD Ryzen 3 3100 4-Co...Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz - 125,7 tok/s Generation, 1.395 tok/s Prefill, TTFT 8.754 ms (9 Laufe)Intel(R) Core(TM) i5-...Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) - 56,2 tok/s Generation, 1.002 tok/s Prefill, TTFT 2.226 ms (1 Lauf)Apple M6 (unified CPU...Apple M6 (unified CPU/GPU SoC) - 42,3 tok/s Generation, 1.132 tok/s Prefill, TTFT 2.150 ms (2 Laufe)Apple M6 (unified CPU...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 8,0 tok/s Generation, 63 tok/s Prefill, TTFT 139.289 ms (3 Laufe)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 2.182,7 tok/sAMD Ryzen 5 5600X 6-Core Processor 2.144,3 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.937,7 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1.878,7 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 1.485,1 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 1.197,0 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 992,1 tok/sNVIDIA Grace 367,8 tok/sAMD Ryzen 3 3100 4-Core Processor 344,9 tok/sIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz 125,7 tok/sApple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) 56,2 tok/sApple M6 (unified CPU/GPU SoC) 42,3 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 8,0 tok/s

ENGnach Engine

2.8292.1221.4157070,009.83419.66829.503Prefill (tok/s)Generation (tok/s)llama.cpp - 2.182,7 tok/s Generation, 4.580 tok/s Prefill, TTFT 12.174 ms (63 Laufe)llama.cppvLLM - 1.485,1 tok/s Generation, 23.938 tok/s Prefill, TTFT 583 ms (6 Laufe)vLLMlmstudio-mlx - 56,2 tok/s Generation, 1.002 tok/s Prefill, TTFT 2.226 ms (1 Lauf)lmstudio-mlxOllama - 42,3 tok/s Generation, 1.132 tok/s Prefill, TTFT 2.150 ms (2 Laufe)Ollama
llama.cpp 2.182,7 tok/svLLM 1.485,1 tok/slmstudio-mlx 56,2 tok/sOllama 42,3 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.182,67 tok/s TG
Prefill 10.599 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.144,30 tok/s TG
Prefill 10.533 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
3NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.937,67 tok/s TG
Prefill 9.452 · TTFT 6.288 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.911,59 tok/s TG
Prefill 10.116 · TTFT 6.245 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.896,98 tok/s TG
Prefill 10.984 · TTFT 6.227 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.878,73 tok/s TG
Prefill 7.717 · TTFT 6.690 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
7NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.830,31 tok/s TG
Prefill 9.399 · TTFT 6.598 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.485,14 tok/s TG
Prefill 44.171 · TTFT 717 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
9NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.196,98 tok/s TG
Prefill 6.074 · TTFT 10.280 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
10NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.188,73 tok/s TG
Prefill 9.032 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
11NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.164,80 tok/s TG
Prefill 6.428 · TTFT 2.540 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
12NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.154,42 tok/s TG
Prefill 8.806 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
13NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.090,59 tok/s TG
Prefill 9.551 · TTFT 2.101 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
14NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.077,40 tok/s TG
Prefill 9.899 · TTFT 2.078 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
15NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.071,04 tok/s TG
Prefill 6.552 · TTFT 2.620 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
16NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.051,12 tok/s TG
Prefill 7.358 · TTFT 2.444 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
992,11 tok/s TG
Prefill 5.920 · TTFT 12.083 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
18NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
899,41 tok/s TG
Prefill 30.214 · TTFT 473 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
19NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
791,54 tok/s TG
Prefill 26.710 · TTFT 1.226 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
20NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
676,42 tok/s TG
Prefill 5.367 · TTFT 3.579 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
21NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
667,02 tok/s TG
Prefill 4.019 · TTFT 17.735 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
22NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,34 tok/s TG
Prefill 4.936 · TTFT 17.123 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
23NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,37 tok/s TG
Prefill 4.530 · TTFT 17.991 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
24NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
596,31 tok/s TG
Prefill 5.389 · TTFT 4.001 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
25NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
478,23 tok/s TG
Prefill 20.306 · TTFT 679 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
26NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
393,52 tok/s TG
Prefill 1.898 · TTFT 1.302 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
27NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
393,46 tok/s TG
Prefill 4.408 · TTFT 489 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
28NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
382,25 tok/s TG
Prefill 3.656 · TTFT 5.903 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
29NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
375,87 tok/s TG
Prefill 4.619 · TTFT 5.434 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
30NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
367,75 tok/s TG
Prefill 3.397 · TTFT 29.121 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
31NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
362,28 tok/s TG
Prefill 4.209 · TTFT 548 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
32NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
361,36 tok/s TG
Prefill 5.030 · TTFT 428 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
33NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,48 tok/s TG
Prefill 4.148 · TTFT 5.814 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
34NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
356,73 tok/s TG
Prefill 6.221 · TTFT 346 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
35NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
355,57 tok/s TG
Prefill 2.753 · TTFT 1.003 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
36NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
354,29 tok/s TG
Prefill 3.544 · TTFT 30.045 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
37NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
344,85 tok/s TG
Prefill 4.759 · TTFT 5.325 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
38NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,39 tok/s TG
Prefill 5.993 · TTFT 3.672 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
39NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
248,17 tok/s TG
Prefill 4.462 · TTFT 2.412 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
40NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,85 tok/s TG
Prefill 2.967 · TTFT 3.756 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
41NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,91 tok/s TG
Prefill 4.079 · TTFT 528 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
42NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,69 tok/s TG
Prefill 2.376 · TTFT 950 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
43NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,76 tok/s TG
Prefill 13.576 · TTFT 159 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
44NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,25 tok/s TG
Prefill 3.483 · TTFT 8.798 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
45NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
208,19 tok/s TG
Prefill 6.153 · TTFT 3.583 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
46NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
202,30 tok/s TG
Prefill 3.149 · TTFT 9.380 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
47NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,29 tok/s TG
Prefill 4.534 · TTFT 2.375 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
48NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
166,48 tok/s TG
Prefill 4.080 · TTFT 529 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
49NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
139,75 tok/s TG
Prefill 3.025 · TTFT 712 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
50NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
136,24 tok/s TG
Prefill 3.620 · TTFT 595 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
51NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
129,52 tok/s TG
Prefill 3.211 · TTFT 671 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
52NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,68 tok/s TG
Prefill 2.208 · TTFT 11.151 ms
10×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
53NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
124,60 tok/s TG
Prefill 4.092 · TTFT 528 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
54NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,24 tok/s TG
Prefill 1.891 · TTFT 5.975 ms
5×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
55NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,67 tok/s TG
Prefill 8.650 · TTFT 249 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
56NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,92 tok/s TG
Prefill 1.319 · TTFT 18.921 ms
10×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
57NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,11 tok/s TG
Prefill 1.440 · TTFT 17.007 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
58NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,85 tok/s TG
Prefill 2.620 · TTFT 821 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0
59NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,31 tok/s TG
Prefill 1.092 · TTFT 10.399 ms
5×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
60NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,04 tok/s TG
Prefill 1.231 · TTFT 9.195 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
61NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
93,42 tok/s TG
Prefill 2.630 · TTFT 822 ms
1×3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
62NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
80,94 tok/s TG
Prefill 1.564 · TTFT 1.376 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
63NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
76,87 tok/s TG
Prefill 2.223 · TTFT 1.006 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
64NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,70 tok/s TG
Prefill 1.798 · TTFT 1.470 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
65NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,37 tok/s TG
Prefill 865 · TTFT 2.489 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
66NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,70 tok/s TG
Prefill 945 · TTFT 2.277 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
67NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
56,16 tok/s TG
Prefill 1.002 · TTFT 2.226 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
68NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,29 tok/s TG
Prefill 1.495 · TTFT 1.438 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliNVFP4
69NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,84 tok/s TG
Prefill 769 · TTFT 2.861 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
70NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,97 tok/s TG
Prefill 72 · TTFT 153.653 ms
5×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
71NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,94 tok/s TG
Prefill 41 · TTFT 62.079 ms
1×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
72NVIDIA-Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,25 tok/s TG
Prefill 75 · TTFT 202.135 ms
10×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.