Created bymario-alka.dePowered bynoob2claw.detricoma.de
Manufacturer

NVIDIA

Nemotron-Modellfamilie von NVIDIA.

14Models
671Benchmarks
669Performance
2Harness
Best token generation
3.484,3 tok/s
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Best prefill
44.171,1 tok/s
NVIDIA-Nemotron-3-Nano-4B
∅ Token generation
275,1 tok/s
Average of 669 runs
∅ Prefill
3.818,4 tok/s
Average of 667 runs
Best TTFT
31 ms
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Best harness rate
80%
Nemotron-Cascade-2-30B-A3B
🏆
NVIDIA-Nemotron-3.5-Lightning-30B-A3B · fastest model at 3.484,3 tok/s token generation
Best prefill of this manufacturer: 44.171,1 tok/s (NVIDIA-Nemotron-3-Nano-4B)

Top models by token generation

Best measured generation throughput per model (tok/s), published performance benchmarks.

NVIDIA-Nemotron-3.5-Lightning-30B-A3B
3.484,3 tok/s
NVIDIA-Nemotron-3-Nano-4B
2.182,7 tok/s
Nemotron-3-Nano-Omni-30B-A3B-Reasoning
1.791,5 tok/s
Nemotron-Cascade-2-30B-A3B
1.784,7 tok/s
NVIDIA-Nemotron-3-Nano-30B-A3B
1.775,6 tok/s
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
1.562,3 tok/s
NVIDIA-Nemotron-3-Super-120B-A12B
600,9 tok/s
OpenReasoning-Nemotron-32B
481,0 tok/s