Created bymario-alka.dePowered bynoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
Size
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
959,22 tok/s TG
Prefill 7.286 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
2Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.706,21 tok/s TG
Prefill 8.777 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
3Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
212,42 tok/s TG
Prefill 4.204 · TTFT 7.880 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
4Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
151,93 tok/s TG
Prefill 3.571 · TTFT 4.182 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
5Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,08 tok/s TG
Prefill 2.192 · TTFT 1.273 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
6Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
468,61 tok/s TG
Prefill 4.836 · TTFT 11.175 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
7Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,82 tok/s TG
Prefill 3.920 · TTFT 3.793 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
8Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
104,95 tok/s TG
Prefill 3.020 · TTFT 909 ms
1×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
9Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
288,80 tok/s TG
Prefill 4.736 · TTFT 6.808 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
10Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
193,11 tok/s TG
Prefill 3.767 · TTFT 3.939 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
11Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,04 tok/s TG
Prefill 3.064 · TTFT 897 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_M
12Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
356,42 tok/s TG
Prefill 16.357 · TTFT 2.480 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
13Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,44 tok/s TG
Prefill 13.079 · TTFT 1.402 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
14Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
109,52 tok/s TG
Prefill 5.943 · TTFT 462 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
15Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
806,94 tok/s TG
Prefill 7.252 · TTFT 13.902 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
16Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
463,93 tok/s TG
Prefill 6.756 · TTFT 4.404 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
17Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,50 tok/s TG
Prefill 4.956 · TTFT 555 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
18Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
477,43 tok/s TG
Prefill 7.813 · TTFT 8.277 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
19Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,96 tok/s TG
Prefill 6.516 · TTFT 2.127 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
20Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
126,89 tok/s TG
Prefill 5.003 · TTFT 550 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
21Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
712,04 tok/s TG
Prefill 35.143 · TTFT 1.137 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
22Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
462,23 tok/s TG
Prefill 24.899 · TTFT 645 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
23Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
147,92 tok/s TG
Prefill 11.709 · TTFT 234 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
24Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
836,37 tok/s TG
Prefill 39.157 · TTFT 1.033 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
25Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
580,46 tok/s TG
Prefill 29.873 · TTFT 587 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
26Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,89 tok/s TG
Prefill 12.970 · TTFT 212 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
27Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
344,15 tok/s TG
Prefill 15.326 · TTFT 2.709 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
28Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
234,43 tok/s TG
Prefill 11.921 · TTFT 1.518 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
29Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,14 tok/s TG
Prefill 4.429 · TTFT 645 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT4
30Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
810,27 tok/s TG
Prefill 7.685 · TTFT 13.735 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
31Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
467,41 tok/s TG
Prefill 6.778 · TTFT 4.374 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
32Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,89 tok/s TG
Prefill 4.988 · TTFT 551 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
33Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
502,52 tok/s TG
Prefill 7.839 · TTFT 8.284 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
34Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,53 tok/s TG
Prefill 6.972 · TTFT 1.971 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
35Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
126,49 tok/s TG
Prefill 5.012 · TTFT 548 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
36Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
655,42 tok/s TG
Prefill 30.671 · TTFT 1.283 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
37Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
409,55 tok/s TG
Prefill 23.648 · TTFT 741 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
38Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
137,12 tok/s TG
Prefill 10.007 · TTFT 275 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
39Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
771,80 tok/s TG
Prefill 34.194 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
40Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
525,52 tok/s TG
Prefill 25.936 · TTFT 678 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
41Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
174,29 tok/s TG
Prefill 10.685 · TTFT 258 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
42Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
394,94 tok/s TG
Prefill 21.192 · TTFT 1.768 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
43Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
261,01 tok/s TG
Prefill 15.938 · TTFT 1.003 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
44Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,59 tok/s TG
Prefill 7.915 · TTFT 347 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
45Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
488,87 tok/s TG
Prefill 23.837 · TTFT 1.604 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
46Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
364,01 tok/s TG
Prefill 18.353 · TTFT 886 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
47Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
143,51 tok/s TG
Prefill 8.883 · TTFT 309 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
48Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,81 tok/s TG
Prefill 5 · TTFT 459.880 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
49Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,95 tok/s TG
Prefill 5 · TTFT 428.772 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
50Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,57 tok/s TG
Prefill 5 · TTFT 411.512 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
51Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,91 tok/s TG
Prefill 5 · TTFT 408.023 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
52Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,84 tok/s TG
Prefill 5 · TTFT 423.222 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
53Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,90 tok/s TG
Prefill 5 · TTFT 429.316 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
54Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,85 tok/s TG
Prefill 5 · TTFT 407.941 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
55Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
774,90 tok/s TG
Prefill 3.820 · TTFT 15.880 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
56Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
429,63 tok/s TG
Prefill 3.334 · TTFT 6.284 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
57Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,13 tok/s TG
Prefill 2.928 · TTFT 938 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
58Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
774,10 tok/s TG
Prefill 3.866 · TTFT 16.399 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
59Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
437,16 tok/s TG
Prefill 3.329 · TTFT 6.298 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
60Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,22 tok/s TG
Prefill 2.941 · TTFT 933 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
61Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
697,82 tok/s TG
Prefill 2.814 · TTFT 19.437 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
62Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
413,18 tok/s TG
Prefill 2.358 · TTFT 8.016 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
63Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,97 tok/s TG
Prefill 2.205 · TTFT 1.246 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
64Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
762,72 tok/s TG
Prefill 4.616 · TTFT 15.283 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
65Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
440,78 tok/s TG
Prefill 3.886 · TTFT 5.752 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
66Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
777,69 tok/s TG
Prefill 3.903 · TTFT 16.458 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
67Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
434,94 tok/s TG
Prefill 3.365 · TTFT 6.267 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
68Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
706,85 tok/s TG
Prefill 2.752 · TTFT 19.766 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
69Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
405,17 tok/s TG
Prefill 2.414 · TTFT 7.850 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
70Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,82 tok/s TG
Prefill 177 · TTFT 255.495 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
71Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,50 tok/s TG
Prefill 157 · TTFT 125.739 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
72Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,12 tok/s TG
Prefill 157 · TTFT 17.486 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
73Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
781,43 tok/s TG
Prefill 3.666 · TTFT 16.232 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
74Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
456,52 tok/s TG
Prefill 3.165 · TTFT 6.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
75Laguna-S-2.1-INT4117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
145,95 tok/s TG
Prefill 2.846 · TTFT 964 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
76Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,83 tok/s TG
Prefill 5 · TTFT 410.851 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
77Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 410.515 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
78Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,90 tok/s TG
Prefill 5 · TTFT 409.419 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
79Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,81 tok/s TG
Prefill 5 · TTFT 410.587 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
80Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,79 tok/s TG
Prefill 5 · TTFT 414.339 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
81Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,96 tok/s TG
Prefill 5 · TTFT 418.804 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
82Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 408.262 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
83Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,91 tok/s TG
Prefill 5 · TTFT 413.865 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
84Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 416.638 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
85Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,52 tok/s TG
Prefill 5 · TTFT 387.271 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
86Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,97 tok/s TG
Prefill 5 · TTFT 395.460 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
87Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,01 tok/s TG
Prefill 5 · TTFT 397.363 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
88Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
102,53 tok/s TG
Prefill 311 · TTFT 161.346 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
89Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,85 tok/s TG
Prefill 254 · TTFT 70.881 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
90Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,25 tok/s TG
Prefill 204 · TTFT 13.469 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
91Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 308 · TTFT 162.990 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
92Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,82 tok/s TG
Prefill 253 · TTFT 70.884 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
93Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,97 tok/s TG
Prefill 203 · TTFT 13.549 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
94Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
102,20 tok/s TG
Prefill 309 · TTFT 162.437 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
95Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,59 tok/s TG
Prefill 252 · TTFT 71.355 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
96Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,67 tok/s TG
Prefill 203 · TTFT 13.592 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
97Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,51 tok/s TG
Prefill 98 · TTFT 302.732 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
98Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,64 tok/s TG
Prefill 89 · TTFT 183.222 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
99Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,60 tok/s TG
Prefill 76 · TTFT 36.406 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
100Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,27 tok/s TG
Prefill 100 · TTFT 306.428 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
101Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,83 tok/s TG
Prefill 87 · TTFT 185.676 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
102Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,44 tok/s TG
Prefill 76 · TTFT 36.141 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
103Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,47 tok/s TG
Prefill 97 · TTFT 309.056 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
104Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,65 tok/s TG
Prefill 86 · TTFT 187.895 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
105Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,64 tok/s TG
Prefill 76 · TTFT 36.235 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawINT4
106Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,90 tok/s TG
Prefill 31 · TTFT 291.485 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
107Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,87 tok/s TG
Prefill 31 · TTFT 286.032 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
108Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,03 tok/s TG
Prefill 30 · TTFT 91.117 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
109Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,93 tok/s TG
Prefill 31 · TTFT 288.198 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
110Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,98 tok/s TG
Prefill 31 · TTFT 288.357 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
111Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,06 tok/s TG
Prefill 29 · TTFT 94.249 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
112Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,05 tok/s TG
Prefill 31 · TTFT 286.662 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
113Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,16 tok/s TG
Prefill 31 · TTFT 286.772 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
114Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,09 tok/s TG
Prefill 30 · TTFT 89.440 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
115Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,68 tok/s TG
Prefill 5 · TTFT 412.837 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
116Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,51 tok/s TG
Prefill 5 · TTFT 391.984 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
117Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,84 tok/s TG
Prefill 5 · TTFT 401.206 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
118Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,76 tok/s TG
Prefill 5 · TTFT 397.216 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
119Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,92 tok/s TG
Prefill 5 · TTFT 406.612 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
120Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,80 tok/s TG
Prefill 5 · TTFT 407.953 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
121Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,88 tok/s TG
Prefill 5 · TTFT 401.414 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
122Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,71 tok/s TG
Prefill 5 · TTFT 392.723 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
123Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,88 tok/s TG
Prefill 5 · TTFT 405.191 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
124Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,89 tok/s TG
Prefill 6 · TTFT 385.101 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
125Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,86 tok/s TG
Prefill 5 · TTFT 399.841 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
126Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
334,72 tok/s TG
Prefill 2.246 · TTFT 36.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
127Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,49 tok/s TG
Prefill 2.071 · TTFT 12.702 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
128Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,38 tok/s TG
Prefill 1.555 · TTFT 1.746 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
129Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
334,41 tok/s TG
Prefill 2.100 · TTFT 37.421 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
130Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,66 tok/s TG
Prefill 2.017 · TTFT 12.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
131Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,48 tok/s TG
Prefill 1.516 · TTFT 1.792 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
132Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
835,13 tok/s TG
Prefill 3.499 · TTFT 16.577 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
133Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,82 tok/s TG
Prefill 3.019 · TTFT 6.496 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
134Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
146,11 tok/s TG
Prefill 2.580 · TTFT 1.064 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
135Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,97 tok/s TG
Prefill 45 · TTFT 191.746 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
136Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 50 · TTFT 181.487 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
137Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,63 tok/s TG
Prefill 53 · TTFT 50.822 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
138Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
791,09 tok/s TG
Prefill 3.559 · TTFT 16.497 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
139Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
470,52 tok/s TG
Prefill 3.067 · TTFT 6.420 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
140Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
334,40 tok/s TG
Prefill 2.260 · TTFT 36.888 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
141Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,27 tok/s TG
Prefill 2.011 · TTFT 12.859 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
142Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
321,42 tok/s TG
Prefill 2.147 · TTFT 37.376 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
143Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
186,37 tok/s TG
Prefill 1.992 · TTFT 12.967 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
144Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 48 · TTFT 182.972 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
145Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,80 tok/s TG
Prefill 49 · TTFT 183.700 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
146Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,55 tok/s TG
Prefill 174 · TTFT 246.888 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
147Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,54 tok/s TG
Prefill 157 · TTFT 125.314 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
148Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,06 tok/s TG
Prefill 156 · TTFT 17.644 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
149Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,87 tok/s TG
Prefill 88 · TTFT 196.186 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
150Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
776,08 tok/s TG
Prefill 4.515 · TTFT 15.579 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
151Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
434,78 tok/s TG
Prefill 3.944 · TTFT 5.525 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
152Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,75 tok/s TG
Prefill 3.130 · TTFT 877 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
153Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
779,78 tok/s TG
Prefill 3.841 · TTFT 16.300 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
154Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
415,35 tok/s TG
Prefill 3.365 · TTFT 5.876 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
155Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
135,51 tok/s TG
Prefill 2.905 · TTFT 945 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
156Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
662,97 tok/s TG
Prefill 2.731 · TTFT 19.776 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
157Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
408,67 tok/s TG
Prefill 2.354 · TTFT 8.049 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
158Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
131,71 tok/s TG
Prefill 2.197 · TTFT 1.250 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
159Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,32 tok/s TG
Prefill 98 · TTFT 206.915 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
160Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,80 tok/s TG
Prefill 100 · TTFT 27.502 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
161Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,65 tok/s TG
Prefill 5 · TTFT 428.043 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketFP8
162Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,17 tok/s TG
Prefill 41 · TTFT 216.967 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
163Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,28 tok/s TG
Prefill 1.496 · TTFT 42.551 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
164Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,50 tok/s TG
Prefill 1.351 · TTFT 15.992 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
165Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,50 tok/s TG
Prefill 1.209 · TTFT 2.272 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
166Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,03 tok/s TG
Prefill 42 · TTFT 216.252 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
167Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,17 tok/s TG
Prefill 1.479 · TTFT 42.546 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
168Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
203,41 tok/s TG
Prefill 1.372 · TTFT 16.012 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
169Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,20 tok/s TG
Prefill 1.206 · TTFT 2.277 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
170Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,30 tok/s TG
Prefill 29 · TTFT 74.552 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
171Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,94 tok/s TG
Prefill 1.446 · TTFT 42.781 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
172Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,44 tok/s TG
Prefill 1.300 · TTFT 16.378 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
173Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,39 tok/s TG
Prefill 1.195 · TTFT 2.302 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
174Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,08 tok/s TG
Prefill 8 · TTFT 281.078 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
175Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.620,41 tok/s TG
Prefill 12.519 · TTFT 7.197 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
176Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
874,29 tok/s TG
Prefill 9.000 · TTFT 2.704 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
177Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,64 tok/s TG
Prefill 6.739 · TTFT 408 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
178Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,66 tok/s TG
Prefill 10.675 · TTFT 7.505 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
179Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
877,73 tok/s TG
Prefill 9.525 · TTFT 2.629 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
180Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,83 tok/s TG
Prefill 4.894 · TTFT 561 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
181Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.533,70 tok/s TG
Prefill 6.831 · TTFT 8.783 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
182Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
861,47 tok/s TG
Prefill 6.618 · TTFT 3.232 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
183Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
275,54 tok/s TG
Prefill 4.697 · TTFT 600 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
184Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.629,91 tok/s TG
Prefill 11.384 · TTFT 7.322 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
185Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
869,75 tok/s TG
Prefill 11.997 · TTFT 2.389 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
186Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,91 tok/s TG
Prefill 8.295 · TTFT 331 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
187Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,39 tok/s TG
Prefill 11.312 · TTFT 7.410 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
188Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
871,59 tok/s TG
Prefill 9.810 · TTFT 2.601 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
189Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.740,12 tok/s TG
Prefill 8.571 · TTFT 7.786 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
190Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
274,31 tok/s TG
Prefill 6.386 · TTFT 430 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
191Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
972,04 tok/s TG
Prefill 7.593 · TTFT 2.866 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
192Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.532,89 tok/s TG
Prefill 7.482 · TTFT 8.633 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
193Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
307,85 tok/s TG
Prefill 5.879 · TTFT 467 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliINT4
194Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
861,53 tok/s TG
Prefill 6.372 · TTFT 3.336 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
195Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.764,99 tok/s TG
Prefill 8.542 · TTFT 7.776 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
196Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,05 tok/s TG
Prefill 4.855 · TTFT 565 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
197Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
959,86 tok/s TG
Prefill 7.429 · TTFT 2.902 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
198Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
308,21 tok/s TG
Prefill 5.712 · TTFT 481 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
199Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.620,45 tok/s TG
Prefill 10.729 · TTFT 7.428 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
200Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.738,38 tok/s TG
Prefill 8.872 · TTFT 7.722 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
201Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
871,77 tok/s TG
Prefill 11.025 · TTFT 2.465 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
202Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,45 tok/s TG
Prefill 7.505 · TTFT 373 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
203Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
965,66 tok/s TG
Prefill 7.691 · TTFT 2.852 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
204Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
308,34 tok/s TG
Prefill 5.678 · TTFT 484 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
205Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.609,12 tok/s TG
Prefill 10.883 · TTFT 7.452 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
206Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
876,74 tok/s TG
Prefill 9.643 · TTFT 2.610 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
207Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,58 tok/s TG
Prefill 6.464 · TTFT 425 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
208Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.554,46 tok/s TG
Prefill 7.954 · TTFT 8.418 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
209Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
869,07 tok/s TG
Prefill 7.024 · TTFT 3.115 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
210Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
275,74 tok/s TG
Prefill 5.897 · TTFT 466 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
211Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
979,74 tok/s TG
Prefill 5.175 · TTFT 13.143 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
212Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
584,39 tok/s TG
Prefill 4.467 · TTFT 4.864 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
213Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,25 tok/s TG
Prefill 3.820 · TTFT 720 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
214Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
981,72 tok/s TG
Prefill 5.166 · TTFT 13.134 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
215Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
582,20 tok/s TG
Prefill 4.480 · TTFT 4.869 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
216Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,34 tok/s TG
Prefill 3.833 · TTFT 717 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
217Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
986,05 tok/s TG
Prefill 5.179 · TTFT 13.058 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
218Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
586,52 tok/s TG
Prefill 4.479 · TTFT 4.845 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
219Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,29 tok/s TG
Prefill 3.814 · TTFT 720 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
220Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.753,82 tok/s TG
Prefill 9.267 · TTFT 7.329 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
221Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
967,89 tok/s TG
Prefill 8.250 · TTFT 2.709 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
222Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,54 tok/s TG
Prefill 5.382 · TTFT 511 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
223Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.757,37 tok/s TG
Prefill 9.025 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
224Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
966,13 tok/s TG
Prefill 8.310 · TTFT 2.703 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
225Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,93 tok/s TG
Prefill 4.887 · TTFT 562 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
226Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.740,43 tok/s TG
Prefill 9.653 · TTFT 7.258 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
227Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
975,10 tok/s TG
Prefill 7.343 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
228Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
310,19 tok/s TG
Prefill 5.706 · TTFT 484 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
229Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,35 tok/s TG
Prefill 1.470 · TTFT 42.801 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
230Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.606,11 tok/s TG
Prefill 12.690 · TTFT 7.203 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
231Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
875,59 tok/s TG
Prefill 11.578 · TTFT 2.412 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
232Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.615,26 tok/s TG
Prefill 13.041 · TTFT 7.166 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
233Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
865,51 tok/s TG
Prefill 12.041 · TTFT 2.375 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
234Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
797,14 tok/s TG
Prefill 3.616 · TTFT 16.087 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
235Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.611,02 tok/s TG
Prefill 12.725 · TTFT 7.223 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
236Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.348 · TTFT 16.034 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
237Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
871,83 tok/s TG
Prefill 11.767 · TTFT 2.401 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
238Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
461,99 tok/s TG
Prefill 3.219 · TTFT 6.266 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
239Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,47 tok/s TG
Prefill 1.427 · TTFT 42.816 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
240Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.327 · TTFT 16.066 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
241Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
319,02 tok/s TG
Prefill 1.498 · TTFT 42.331 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
242Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,31 tok/s TG
Prefill 1.375 · TTFT 15.932 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
243Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,06 tok/s TG
Prefill 8 · TTFT 255.194 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
244Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,92 tok/s TG
Prefill 8 · TTFT 253.028 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketFP8
245Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,76 tok/s TG
Prefill 8 · TTFT 264.875 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
246Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
42,33 tok/s TG
Prefill 153 · TTFT 257.193 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
247Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,70 tok/s TG
Prefill 134 · TTFT 130.995 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
248Laguna-S-2.1117.6BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,62 tok/s TG
Prefill 130 · TTFT 21.118 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
249Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
337,60 tok/s TG
Prefill 2.103 · TTFT 37.017 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
250Laguna-M.1225.8BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
183,76 tok/s TG
Prefill 1.927 · TTFT 13.105 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M