Created bymario-alka.dePowered bynoob2claw.detricoma.de
OpenAI

gpt-oss-120b120B

Benchmark profile and published results.

MoE120B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation1.335,9 tok/s
Min 0,0Ø 245,7Max 3.484,3
Ueber dem Durchschnitt · 4971 Systeme im Feld
Prefill9.543 tok/s
Min 4Ø 4.892Max 112.346
Ueber dem Durchschnitt · 4953 Systeme im Feld
Time to First Token382 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

1.7361.3028684340,002.6045.2097.813Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 1.335,9 tok/s Generation, 5.805 tok/s Prefill, TTFT 4.872 ms (5 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.229,7 tok/s Generation, 6.303 tok/s Prefill, TTFT 4.302 ms (12 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon PRO W7900 Dual Slot - 216,2 tok/s Generation, 1.083 tok/s Prefill, TTFT 9.148 ms (3 Laufe)AMD Radeon PRO W7900 ...NVIDIA DGX SPARK (GB10) - 135,1 tok/s Generation, 1.449 tok/s Prefill, TTFT 7.087 ms (3 Laufe)NVIDIA DGX SPARK (GB1...NVIDIA RTX SPARK (N1X) - 111,9 tok/s Generation, 1.334 tok/s Prefill, TTFT 8.374 ms (4 Laufe)NVIDIA RTX SPARK (N1X)AMD Radeon AI PRO R9700 - 107,0 tok/s Generation, 1.057 tok/s Prefill, TTFT 67.151 ms (13 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 3090 Ti - 85,3 tok/s Generation, 238 tok/s Prefill, TTFT 79.784 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5070 Ti - 60,1 tok/s Generation, 195 tok/s Prefill, TTFT 69.936 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 5090 - 42,3 tok/s Generation, 239 tok/s Prefill, TTFT 76.971 ms (5 Laufe)NVIDIA GeForce RTX 50...Intel Arc Pro B70 - 32,4 tok/s Generation, 47 tok/s Prefill, TTFT 184.310 ms (3 Laufe)Intel Arc Pro B70NVIDIA GeForce RTX 3090 - 18,1 tok/s Generation, 96 tok/s Prefill, TTFT 20.531 ms (1 Lauf)NVIDIA GeForce RTX 30...AMD Radeon RX 7900 XTX - 16,3 tok/s Generation, 100 tok/s Prefill, TTFT 104.661 ms (3 Laufe)AMD Radeon RX 7900 XTXNVIDIA GeForce RTX 2060 - 6,8 tok/s Generation, 16 tok/s Prefill, TTFT 131.537 ms (1 Lauf)NVIDIA GeForce RTX 20...CPU-only - 5,3 tok/s Generation, 42 tok/s Prefill, TTFT 165.568 ms (3 Laufe)CPU-only
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.335,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.229,7 tok/sAMD Radeon PRO W7900 Dual Slot 216,2 tok/sNVIDIA DGX SPARK (GB10) 135,1 tok/sNVIDIA RTX SPARK (N1X) 111,9 tok/sAMD Radeon AI PRO R9700 107,0 tok/sNVIDIA GeForce RTX 3090 Ti 85,3 tok/sNVIDIA GeForce RTX 5070 Ti 60,1 tok/sNVIDIA GeForce RTX 5090 42,3 tok/sIntel Arc Pro B70 32,4 tok/sNVIDIA GeForce RTX 3090 18,1 tok/sAMD Radeon RX 7900 XTX 16,3 tok/sNVIDIA GeForce RTX 2060 6,8 tok/sCPU-only 5,3 tok/s

CPUby processor

1.7361.3028684340,002.6035.2067.808Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 1.335,9 tok/s Generation, 5.805 tok/s Prefill, TTFT 4.872 ms (5 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 1.229,7 tok/s Generation, 6.303 tok/s Prefill, TTFT 4.302 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 216,2 tok/s Generation, 639 tok/s Prefill, TTFT 39.542 ms (6 Laufe)AMD Ryzen Threadrippe...NVIDIA Grace - 135,1 tok/s Generation, 1.449 tok/s Prefill, TTFT 7.087 ms (3 Laufe)NVIDIA GraceNVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) - 111,9 tok/s Generation, 1.334 tok/s Prefill, TTFT 8.374 ms (4 Laufe)NVIDIA RTX Spark N1X ...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 107,0 tok/s Generation, 1.057 tok/s Prefill, TTFT 67.151 ms (13 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 85,3 tok/s Generation, 238 tok/s Prefill, TTFT 79.784 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 7 5800X3D 8-Core Processor - 42,3 tok/s Generation, 239 tok/s Prefill, TTFT 76.971 ms (5 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 7945HX with Radeon Graphics - 32,4 tok/s Generation, 47 tok/s Prefill, TTFT 184.310 ms (3 Laufe)AMD Ryzen 9 7945HX wi...AMD Ryzen 5 5600X 6-Core Processor - 18,1 tok/s Generation, 96 tok/s Prefill, TTFT 20.531 ms (1 Lauf)AMD Ryzen 5 5600X 6-C...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 16,3 tok/s Generation, 79 tok/s Prefill, TTFT 111.380 ms (4 Laufe)Intel(R) Xeon(R) CPU ...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 5,3 tok/s Generation, 42 tok/s Prefill, TTFT 165.568 ms (3 Laufe)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 1.335,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.229,7 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 216,2 tok/sNVIDIA Grace 135,1 tok/sNVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) 111,9 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 107,0 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 85,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 42,3 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 32,4 tok/sAMD Ryzen 5 5600X 6-Core Processor 18,1 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 16,3 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 5,3 tok/s

ENGby engine

1.7321.2998664330,01.2352.0082.7813.554Prefill (tok/s)Generation (tok/s)llama.cpp - 1.335,9 tok/s Generation, 2.162 tok/s Prefill, TTFT 58.706 ms (57 Laufe)llama.cppunbekannt - 99,8 tok/s Generation, 3.110 tok/s Prefill, TTFT 789 ms (2 Laufe)unbekanntvLLM - 21,5 tok/s Generation, 1.679 tok/s Prefill, TTFT 10.998 ms (3 Laufe)vLLM
llama.cpp 1.335,9 tok/sunbekannt 99,8 tok/svLLM 21,5 tok/s
Throughput & latency

Performance benchmark

Metric:
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.335,85 tok/s TG
Prefill 6.805 · TTFT 8.787 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.274,68 tok/s TG
Prefill 6.447 · TTFT 8.887 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
3gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.229,72 tok/s TG
Prefill 9.543 · TTFT 8.771 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.220,77 tok/s TG
Prefill 7.425 · TTFT 9.155 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.214,90 tok/s TG
Prefill 7.954 · TTFT 9.043 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,29 tok/s TG
Prefill 5.433 · TTFT 10.439 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
7gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
774,35 tok/s TG
Prefill 5.796 · TTFT 3.127 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
8gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
765,17 tok/s TG
Prefill 6.482 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
9gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
706,49 tok/s TG
Prefill 8.061 · TTFT 2.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
706,35 tok/s TG
Prefill 8.636 · TTFT 2.783 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
704,20 tok/s TG
Prefill 6.832 · TTFT 3.038 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
684,36 tok/s TG
Prefill 4.762 · TTFT 3.642 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
13gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
281,92 tok/s TG
Prefill 3.493 · TTFT 568 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
14gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
251,59 tok/s TG
Prefill 5.195 · TTFT 382 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
15gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,58 tok/s TG
Prefill 4.273 · TTFT 463 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
16gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,33 tok/s TG
Prefill 3.723 · TTFT 540 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,47 tok/s TG
Prefill 3.802 · TTFT 520 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 1.128 · TTFT 8.806 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
19gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,75 tok/s TG
Prefill 1.247 · TTFT 16.274 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
20gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,08 tok/s TG
Prefill 1.548 · TTFT 12.948 ms
10×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
21gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
111,85 tok/s TG
Prefill 2.041 · TTFT 17.689 ms
10×NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAMllama.cppopenclaw_cliMXFP4
22gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,02 tok/s TG
Prefill 173 · TTFT 186.661 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
23gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,85 tok/s TG
Prefill 172 · TTFT 186.714 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
24gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
105,39 tok/s TG
Prefill 170 · TTFT 189.655 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
25gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 874 · TTFT 2.364 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
26gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,67 tok/s TG
Prefill 1.446 · TTFT 6.855 ms
5×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
27gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
99,77 tok/s TG
Prefill 1.920 · TTFT 1.022 ms
1×3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
28gpt-oss-120b120BOpenAI Performance benchmark
99,77 tok/s TG
Prefill 1.920 · TTFT 1.022 ms
1×3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_M
29gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
85,33 tok/s TG
Prefill 270 · TTFT 166.013 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
30gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,06 tok/s TG
Prefill 1.478 · TTFT 11.284 ms
5×NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAMllama.cppopenclaw_cliMXFP4
31gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
63,33 tok/s TG
Prefill 138 · TTFT 85.637 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
32gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,23 tok/s TG
Prefill 1.354 · TTFT 1.459 ms
1×NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
33gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,02 tok/s TG
Prefill 136 · TTFT 86.915 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
34gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,91 tok/s TG
Prefill 137 · TTFT 86.144 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,05 tok/s TG
Prefill 224 · TTFT 126.906 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
36gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,10 tok/s TG
Prefill 190 · TTFT 71.280 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
37gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
51,30 tok/s TG
Prefill 232 · TTFT 64.035 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
38gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
51,11 tok/s TG
Prefill 899 · TTFT 2.279 ms
1×NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAMllama.cppopenclaw_cliMXFP4
39gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,95 tok/s TG
Prefill 919 · TTFT 2.243 ms
1×NVIDIA RTX SPARK (N1X)NVIDIA RTX Spark N1X (6144-core GPU, 20-core CPU) · 128 GB RAMllama.cppopenclaw_cliMXFP4
40gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
42,26 tok/s TG
Prefill 170 · TTFT 234.298 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
41gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,41 tok/s TG
Prefill 50 · TTFT 226.449 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
42gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,26 tok/s TG
Prefill 149 · TTFT 103.687 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
43gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
26,57 tok/s TG
Prefill 50 · TTFT 276.964 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
44gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,08 tok/s TG
Prefill 124 · TTFT 15.977 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
45gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,82 tok/s TG
Prefill 123 · TTFT 16.131 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
46gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,79 tok/s TG
Prefill 124 · TTFT 15.976 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
47gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,48 tok/s TG
Prefill 4.300 · TTFT 556 ms
1×3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw4-Bit
48gpt-oss-120b120BOpenAI Performance benchmark
21,48 tok/s TG
Prefill 4.300 · TTFT 556 ms
1×3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
49gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,12 tok/s TG
Prefill 213 · TTFT 9.303 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
50gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,92 tok/s TG
Prefill 170 · TTFT 11.622 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
51gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
18,07 tok/s TG
Prefill 96 · TTFT 20.531 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
52gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,34 tok/s TG
Prefill 115 · TTFT 189.253 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
53gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,32 tok/s TG
Prefill 405 · TTFT 26.375 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cli
54gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,82 tok/s TG
Prefill 40 · TTFT 49.516 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
55gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,57 tok/s TG
Prefill 137 · TTFT 14.433 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
56gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,17 tok/s TG
Prefill 102 · TTFT 100.889 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
57gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,79 tok/s TG
Prefill 16 · TTFT 131.537 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
58gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,77 tok/s TG
Prefill 84 · TTFT 23.842 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
59gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,46 tok/s TG
Prefill 333 · TTFT 6.064 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cli
60gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,29 tok/s TG
Prefill 56 · TTFT 189.966 ms
5×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
61gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,46 tok/s TG
Prefill 50 · TTFT 39.304 ms
1×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
62gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,05 tok/s TG
Prefill 20 · TTFT 267.436 ms
10×Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.