Created bymario-alka.dePowered bynoob2claw.detricoma.de
Poolside

Laguna-S-2.1-INT4117.6B

Benchmarkprofil und veröffentlichte Ergebnisse.

MoE117.6B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation781,4 tok/s
Min 0,0Ø 245,7Max 3.484,3
Ueber dem Durchschnitt · 4971 Systeme im Feld
Prefill4.616 tok/s
Min 4Ø 4.892Max 112.346
Unter dem Durchschnitt · 4953 Systeme im Feld
Time to First Token933 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

1.0097575052520,001.3272.6553.982Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 781,4 tok/s Generation, 3.226 tok/s Prefill, TTFT 7.860 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 777,7 tok/s Generation, 3.235 tok/s Prefill, TTFT 9.787 ms (15 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 3090 Ti - 32,8 tok/s Generation, 164 tok/s Prefill, TTFT 132.906 ms (3 Laufe)NVIDIA GeForce RTX 30...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 781,4 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 777,7 tok/sNVIDIA GeForce RTX 3090 Ti 32,8 tok/s

CPUnach Prozessor

1.0097575052520,001.3272.6553.982Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 781,4 tok/s Generation, 3.226 tok/s Prefill, TTFT 7.860 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 777,7 tok/s Generation, 3.235 tok/s Prefill, TTFT 9.787 ms (15 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 32,8 tok/s Generation, 164 tok/s Prefill, TTFT 132.906 ms (3 Laufe)AMD Ryzen 9 8945HX wi...
AMD Ryzen 9 9950X 16-Core Processor 781,4 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 777,7 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 32,8 tok/s

ENGnach Engine

8608217817427032.6272.7392.8512.963Prefill (tok/s)Generation (tok/s)llama.cpp - 781,4 tok/s Generation, 2.795 tok/s Prefill, TTFT 27.100 ms (21 Laufe)llama.cpp
llama.cpp 781,4 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
781,43 tok/s TG
Prefill 3.666 · TTFT 16.232 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
2Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
777,69 tok/s TG
Prefill 3.903 · TTFT 16.458 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
3Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,90 tok/s TG
Prefill 3.820 · TTFT 15.880 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
4Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,10 tok/s TG
Prefill 3.866 · TTFT 16.399 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
5Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
762,72 tok/s TG
Prefill 4.616 · TTFT 15.283 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
6Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
706,85 tok/s TG
Prefill 2.752 · TTFT 19.766 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
7Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,82 tok/s TG
Prefill 2.814 · TTFT 19.437 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
8Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
456,52 tok/s TG
Prefill 3.165 · TTFT 6.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
9Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
440,78 tok/s TG
Prefill 3.886 · TTFT 5.752 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
10Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
437,16 tok/s TG
Prefill 3.329 · TTFT 6.298 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
11Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
434,94 tok/s TG
Prefill 3.365 · TTFT 6.267 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
12Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
429,63 tok/s TG
Prefill 3.334 · TTFT 6.284 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
13Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
413,18 tok/s TG
Prefill 2.358 · TTFT 8.016 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
14Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
405,17 tok/s TG
Prefill 2.414 · TTFT 7.850 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
15Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,95 tok/s TG
Prefill 2.846 · TTFT 964 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4
16Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
135,22 tok/s TG
Prefill 2.941 · TTFT 933 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
17Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
135,13 tok/s TG
Prefill 2.928 · TTFT 938 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
18Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,97 tok/s TG
Prefill 2.205 · TTFT 1.246 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawINT4
19Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,82 tok/s TG
Prefill 177 · TTFT 255.495 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
20Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,50 tok/s TG
Prefill 157 · TTFT 125.739 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
21Laguna-S-2.1-INT4117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,12 tok/s TG
Prefill 157 · TTFT 17.486 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketINT4
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.