Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🎮
Grafikkarte

NVIDIA GeForce RTX 2060

NVIDIA6 GB VRAM
78Benchmarks
21Modelle
78Performance
0Harness
10 WIdle-Leistung
160 WMax-Leistung
Beste Generation
259,9 tok/s
Qwen2.5-3B-Instruct
∅ Generation
71,9 tok/s
Schnitt aus 78 Läufen
Bester Prefill
9.775 tok/s
Prompt-Verarbeitung
Bester TTFT
569 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
Qwen2.5-3B-Instruct läuft am schnellsten auf dieser GPU · 259,9 tok/s
Bester Prefill: 9.775 tok/s · 21 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf NVIDIA GeForce RTX 2060 – umschaltbar nach Generation, Prefill oder Kombiwert.

Qwen2.5-3B-Instruct3B
259,9 tok/s
Llama-3.2-3B-Instruct3B
226,6 tok/s
Meta-Llama-3.1-8B-Instruct8B
169,0 tok/s
Qwen2.5-7B-Instruct7B
160,3 tok/s
gemma-4-E4B-it8B
133,7 tok/s
Nemotron-3-Nano-4B4B
125,7 tok/s
Ornith-1.0-9B9B
108,0 tok/s
gemma-4-12B-it12B
89,8 tok/s
Ministral-3-14B-Reasoning-251214B
60,4 tok/s
gemma-4-E2B-it5B
54,7 tok/s
Anzeige
Performanceprofil

Durchsatz auf NVIDIA GeForce RTX 2060

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

33825316984,40,002.8635.7258.588Prefill (tok/s)Generation (tok/s)Qwen2.5-3B-Instruct - 259,9 tok/s Generation, 6.911 tok/s Prefill, TTFT 1.971 ms (6 Laufe)Qwen2.5-3B-InstructLlama-3.2-3B-Instruct - 226,6 tok/s Generation, 6.927 tok/s Prefill, TTFT 2.004 ms (6 Laufe)Llama-3.2-3B-InstructMeta-Llama-3.1-8B-Instruct - 169,0 tok/s Generation, 2.296 tok/s Prefill, TTFT 5.126 ms (10 Laufe)Meta-Llama-3.1-8B-Ins...Qwen2.5-7B-Instruct - 160,3 tok/s Generation, 3.649 tok/s Prefill, TTFT 3.816 ms (3 Laufe)Qwen2.5-7B-Instructgemma-4-E4B-it - 133,7 tok/s Generation, 1.452 tok/s Prefill, TTFT 6.849 ms (6 Laufe)gemma-4-E4B-itNemotron-3-Nano-4B - 125,7 tok/s Generation, 1.395 tok/s Prefill, TTFT 8.754 ms (9 Laufe)Nemotron-3-Nano-4BOrnith-1.0-9B - 108,0 tok/s Generation, 1.606 tok/s Prefill, TTFT 6.161 ms (6 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 89,8 tok/s Generation, 779 tok/s Prefill, TTFT 13.058 ms (3 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 60,4 tok/s Generation, 1.290 tok/s Prefill, TTFT 5.121 ms (2 Laufe)Ministral-3-14B-Reaso...gemma-4-E2B-it - 54,7 tok/s Generation, 2.043 tok/s Prefill, TTFT 6.858 ms (9 Laufe)gemma-4-E2B-itQwen3.6-35B-A3B - 27,5 tok/s Generation, 62 tok/s Prefill, TTFT 180.818 ms (3 Laufe)Qwen3.6-35B-A3BNemotron-3-Nano-30B-A3B - 15,1 tok/s Generation, 36 tok/s Prefill, TTFT 283.946 ms (3 Laufe)Nemotron-3-Nano-30B-A...Qwen3.5-122B-A10B - 7,1 tok/s Generation, 8 tok/s Prefill, TTFT 236.831 ms (1 Lauf)Qwen3.5-122B-A10Bgpt-oss-120b - 6,8 tok/s Generation, 16 tok/s Prefill, TTFT 131.537 ms (1 Lauf)gpt-oss-120bGLM-4.5-Air - 4,2 tok/s Generation, 10 tok/s Prefill, TTFT 226.444 ms (1 Lauf)GLM-4.5-AirSeed-OSS-36B-Instruct - 3,4 tok/s Generation, 43 tok/s Prefill, TTFT 181.856 ms (2 Laufe)Seed-OSS-36B-InstructOpenReasoning-Nemotron-32B - 2,4 tok/s Generation, 45 tok/s Prefill, TTFT 186.332 ms (2 Laufe)OpenReasoning-Nemotro...Qwen2.5-72B-Instruct - 2,3 tok/s Generation, 81 tok/s Prefill, TTFT 569 ms (1 Lauf)Qwen2.5-72B-InstructQwen2.5-Coder-32B-Instruct - 2,3 tok/s Generation, 53 tok/s Prefill, TTFT 145.743 ms (2 Laufe)Qwen2.5-Coder-32B-Ins...Llama-3.3-Nemotron-Super-49B-v1.5 - 1,1 tok/s Generation, 21 tok/s Prefill, TTFT 117.641 ms (1 Lauf)Llama-3.3-Nemotron-Su...Nemotron-H-47B-Reasoning-128K - 1,1 tok/s Generation, 16 tok/s Prefill, TTFT 141.049 ms (1 Lauf)Nemotron-H-47B-Reason...
Qwen2.5-3B-Instruct 259,9 tok/sLlama-3.2-3B-Instruct 226,6 tok/sMeta-Llama-3.1-8B-Instruct 169,0 tok/sQwen2.5-7B-Instruct 160,3 tok/sgemma-4-E4B-it 133,7 tok/sNemotron-3-Nano-4B 125,7 tok/sOrnith-1.0-9B 108,0 tok/sgemma-4-12B-it 89,8 tok/sMinistral-3-14B-Reasoning-2512 60,4 tok/sgemma-4-E2B-it 54,7 tok/sQwen3.6-35B-A3B 27,5 tok/sNemotron-3-Nano-30B-A3B 15,1 tok/sQwen3.5-122B-A10B 7,1 tok/sgpt-oss-120b 6,8 tok/sGLM-4.5-Air 4,2 tok/sSeed-OSS-36B-Instruct 3,4 tok/sOpenReasoning-Nemotron-32B 2,4 tok/sQwen2.5-72B-Instruct 2,3 tok/sQwen2.5-Coder-32B-Instruct 2,3 tok/sLlama-3.3-Nemotron-Super-49B-v1.5 1,1 tok/sNemotron-H-47B-Reasoning-128K 1,1 tok/s

ENGnach Engine

3042592141701252.0252.1312.2382.344Prefill (tok/s)Generation (tok/s)llama.cpp - 259,9 tok/s Generation, 2.205 tok/s Prefill, TTFT 48.045 ms (75 Laufe)llama.cppvLLM - 169,0 tok/s Generation, 2.165 tok/s Prefill, TTFT 9.132 ms (3 Laufe)vLLM
llama.cpp 259,9 tok/svLLM 169,0 tok/s

CPUnach Prozessor

31125419714082,51.1611.8562.5513.246Prefill (tok/s)Generation (tok/s)Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 259,9 tok/s Generation, 2.844 tok/s Prefill, TTFT 85.844 ms (39 Laufe)Intel(R) Xeon(R) CPU ...Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz - 133,7 tok/s Generation, 1.562 tok/s Prefill, TTFT 7.253 ms (39 Laufe)Intel(R) Core(TM) i5-...
Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 259,9 tok/sIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz 133,7 tok/s
Durchsatz & Latenz

Performancebenchmark

78 veroeffentlichte Performance-Läufe auf NVIDIA GeForce RTX 2060.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
259,86 tok/s TG
Prefill 9.253 · TTFT 3.361 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
2Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,59 tok/s TG
Prefill 9.526 · TTFT 3.488 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
3Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
225,82 tok/s TG
Prefill 9.739 · TTFT 3.277 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
4Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,97 tok/s TG
Prefill 9.775 · TTFT 3.283 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
5Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,50 tok/s TG
Prefill 6.698 · TTFT 2.090 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
6Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
173,08 tok/s TG
Prefill 7.158 · TTFT 2.024 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
7Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,96 tok/s TG
Prefill 3.010 · TTFT 18.082 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
8Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,19 tok/s TG
Prefill 7.879 · TTFT 1.850 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
9Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
160,26 tok/s TG
Prefill 4.979 · TTFT 6.510 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
10Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,90 tok/s TG
Prefill 7.616 · TTFT 1.908 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
11gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,73 tok/s TG
Prefill 1.652 · TTFT 12.206 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
12Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,88 tok/s TG
Prefill 4.122 · TTFT 7.946 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
13Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,68 tok/s TG
Prefill 2.208 · TTFT 11.151 ms
10×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
14gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,06 tok/s TG
Prefill 1.687 · TTFT 12.063 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
15Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,88 tok/s TG
Prefill 2.387 · TTFT 7.059 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
16Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,24 tok/s TG
Prefill 1.891 · TTFT 5.975 ms
5×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
17Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
108,79 tok/s TG
Prefill 3.816 · TTFT 3.796 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
18Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
108,03 tok/s TG
Prefill 2.184 · TTFT 10.407 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
19Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,92 tok/s TG
Prefill 1.319 · TTFT 18.921 ms
10×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
20Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,40 tok/s TG
Prefill 3.776 · TTFT 651 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
21Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,11 tok/s TG
Prefill 1.440 · TTFT 17.007 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
22Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,62 tok/s TG
Prefill 3.646 · TTFT 677 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
23Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,31 tok/s TG
Prefill 1.092 · TTFT 10.399 ms
5×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
24Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,04 tok/s TG
Prefill 1.231 · TTFT 9.195 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
25Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
97,31 tok/s TG
Prefill 2.232 · TTFT 10.125 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
26gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,22 tok/s TG
Prefill 1.480 · TTFT 6.689 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
27gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
93,25 tok/s TG
Prefill 1.437 · TTFT 6.874 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
28Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,37 tok/s TG
Prefill 3.202 · TTFT 4.555 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
29gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,80 tok/s TG
Prefill 877 · TTFT 23.528 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
30Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,46 tok/s TG
Prefill 3.210 · TTFT 4.511 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
31Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
80,94 tok/s TG
Prefill 1.564 · TTFT 1.376 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
32Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
80,74 tok/s TG
Prefill 1.579 · TTFT 6.372 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
33Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,93 tok/s TG
Prefill 4.119 · TTFT 596 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
34Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,89 tok/s TG
Prefill 1.619 · TTFT 6.216 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
35Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,37 tok/s TG
Prefill 865 · TTFT 2.489 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
36Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,70 tok/s TG
Prefill 945 · TTFT 2.277 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
37Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,69 tok/s TG
Prefill 3.840 · TTFT 645 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
38Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,51 tok/s TG
Prefill 1.097 · TTFT 2.256 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
39gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,61 tok/s TG
Prefill 776 · TTFT 12.750 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
40Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,39 tok/s TG
Prefill 1.497 · TTFT 8.155 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
41Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
56,92 tok/s TG
Prefill 2.151 · TTFT 1.142 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
42gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,70 tok/s TG
Prefill 3.624 · TTFT 5.459 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
43gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
53,35 tok/s TG
Prefill 1.366 · TTFT 1.447 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
44gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,91 tok/s TG
Prefill 3.620 · TTFT 2.732 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
45Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
48,95 tok/s TG
Prefill 1.278 · TTFT 1.932 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
46Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,41 tok/s TG
Prefill 1.800 · TTFT 1.368 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
47Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,73 tok/s TG
Prefill 1.206 · TTFT 2.050 ms
1×2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
48Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,36 tok/s TG
Prefill 986 · TTFT 1.973 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
49gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
38,32 tok/s TG
Prefill 1.088 · TTFT 1.818 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
50gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,14 tok/s TG
Prefill 2.500 · TTFT 791 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
51Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,83 tok/s TG
Prefill 1.653 · TTFT 1.506 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
52gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,34 tok/s TG
Prefill 684 · TTFT 2.896 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
53Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,62 tok/s TG
Prefill 1.037 · TTFT 1.873 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
54Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,08 tok/s TG
Prefill 1.083 · TTFT 2.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
55Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,51 tok/s TG
Prefill 79 · TTFT 326.271 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
56Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,06 tok/s TG
Prefill 56 · TTFT 178.109 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
57Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,35 tok/s TG
Prefill 51 · TTFT 38.075 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
58gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,30 tok/s TG
Prefill 1.816 · TTFT 1.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
59Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,11 tok/s TG
Prefill 29 · TTFT 379.775 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
60gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 1.763 · TTFT 1.123 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
61Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,88 tok/s TG
Prefill 24 · TTFT 89.272 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
62gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,45 tok/s TG
Prefill 1.249 · TTFT 8.044 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
63gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,43 tok/s TG
Prefill 1.220 · TTFT 8.133 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
64gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,73 tok/s TG
Prefill 1.306 · TTFT 16.890 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
65Qwen3.5-122B-A10B122BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,07 tok/s TG
Prefill 8 · TTFT 236.831 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
66gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,84 tok/s TG
Prefill 1.286 · TTFT 17.461 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
67gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,79 tok/s TG
Prefill 16 · TTFT 131.537 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
68GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,18 tok/s TG
Prefill 10 · TTFT 226.444 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
69Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,44 tok/s TG
Prefill 39 · TTFT 317.771 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
70Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,22 tok/s TG
Prefill 54 · TTFT 382.793 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
71OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,44 tok/s TG
Prefill 39 · TTFT 324.717 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
72Qwen2.5-72B-Instruct72BQwen (Alibaba) PerformancebenchmarkPerformancetest Small 1.0
2,28 tok/s TG
Prefill 81 · TTFT 569 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
73Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,27 tok/s TG
Prefill 62 · TTFT 233.464 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
74Seed-OSS-36B-Instruct36BByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,63 tok/s TG
Prefill 47 · TTFT 45.942 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
75OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,57 tok/s TG
Prefill 51 · TTFT 47.947 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
76Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,54 tok/s TG
Prefill 44 · TTFT 58.023 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
77Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,14 tok/s TG
Prefill 21 · TTFT 117.641 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
78Nemotron-H-47B-Reasoning-128K47BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,12 tok/s TG
Prefill 16 · TTFT 141.049 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA GeForce RTX 2060.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – NVIDIA GeForce RTX 2060

HerstellerNVIDIA
ArchitekturTuring
VRAM6 GB
Tensor-Recheneinheiten240
Speicherbandbreite336 GB/s
TDP160 W
PCIe3.0
Release01/2019
Beste Generation259,9 tok/s
Bester Prefill9.775 tok/s
Modelle21
Messläufe (Performance)78