Created bymario-alka.dePowered bynoob2claw.detricoma.de
🧠
Prozessor

AMD EPYC 7203P 8-Core Processor

AMD
33Benchmarks
3Modelle
33LLM
0Harness
Beste Generation
388,1 tok/s
Ling-3.0-flash
∅ Generation
111,0 tok/s
Schnitt aus 33 Läufen
Bester Prefill
16.198 tok/s
Prompt-Verarbeitung
Bester TTFT
412 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
Ling-3.0-flash läuft am schnellsten auf dieser CPU · 388,1 tok/s
Bester Prefill: 16.198 tok/s · 3 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf AMD EPYC 7203P 8-Core Processor – umschaltbar nach Generation, Prefill oder Kombiwert.

Ling-3.0-flash127.5B
388,1 tok/s
Qwen3.8-Flash-Next180B
79,2 tok/s
Performanceprofil

Durchsatz auf AMD EPYC 7203P 8-Core Processor

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

4893662441220,004.4348.86913.303Prefill (tok/s)Generation (tok/s)Ling-3.0-flash - 388,1 tok/s Generation, 3.235 tok/s Prefill, TTFT 7.234 ms (15 Laufe)Ling-3.0-flashMeta-Llama-3.1-8B-Instruct - 317,0 tok/s Generation, 10.774 tok/s Prefill, TTFT 1.374 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3.8-Flash-Next - 79,2 tok/s Generation, 320 tok/s Prefill, TTFT 39.530 ms (15 Laufe)Qwen3.8-Flash-Next
Ling-3.0-flash 388,1 tok/sMeta-Llama-3.1-8B-Instruct 317,0 tok/sQwen3.8-Flash-Next 79,2 tok/s

ENGnach Engine

46437929521012504.2608.52112.781Prefill (tok/s)Generation (tok/s)vLLM - 388,1 tok/s Generation, 10.431 tok/s Prefill, TTFT 1.459 ms (6 Laufe)vLLMllama.cpp - 201,3 tok/s Generation, 854 tok/s Prefill, TTFT 25.808 ms (27 Laufe)llama.cpp
vLLM 388,1 tok/sllama.cpp 201,3 tok/s

GPUnach Grafikkarte

4274073883693492.4392.5432.6472.751Prefill (tok/s)Generation (tok/s)NVIDIA RTX A6000 - 388,1 tok/s Generation, 2.595 tok/s Prefill, TTFT 21.381 ms (33 Laufe)NVIDIA RTX A6000
NVIDIA RTX A6000 388,1 tok/s
Plattform

Mainboards mit dieser CPU

Auf diesen Boards wurde AMD EPYC 7203P 8-Core Processor gemessen – anklicken für Board-Details mit CPUs und Modellen.

Durchsatz & Latenz

Performancebenchmark

33 veroeffentlichte Performance-Läufe auf AMD EPYC 7203P 8-Core Processor.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
388,05 tok/s TG
Prefill 16.198 · TTFT 2.053 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
2Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
343,90 tok/s TG
Prefill 9.629 · TTFT 1.973 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
3Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
317,00 tok/s TG
Prefill 14.849 · TTFT 2.492 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
4Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
201,32 tok/s TG
Prefill 2.330 · TTFT 11.380 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
5Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
197,94 tok/s TG
Prefill 2.288 · TTFT 11.557 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_M
6Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
194,68 tok/s TG
Prefill 1.934 · TTFT 12.719 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
7Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,45 tok/s TG
Prefill 1.680 · TTFT 6.722 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
8Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,09 tok/s TG
Prefill 1.655 · TTFT 6.827 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_M
9Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,78 tok/s TG
Prefill 1.567 · TTFT 7.199 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
10Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,35 tok/s TG
Prefill 11.565 · TTFT 1.219 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
11Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,60 tok/s TG
Prefill 4.438 · TTFT 606 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4
12Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
92,62 tok/s TG
Prefill 1.185 · TTFT 24.873 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
13Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,29 tok/s TG
Prefill 1.380 · TTFT 1.577 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
14Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,66 tok/s TG
Prefill 1.349 · TTFT 1.612 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_M
15Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
87,74 tok/s TG
Prefill 1.275 · TTFT 1.916 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
16Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,19 tok/s TG
Prefill 670 · TTFT 33.965 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
17Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,50 tok/s TG
Prefill 900 · TTFT 14.075 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
18Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,30 tok/s TG
Prefill 487 · TTFT 20.813 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
19Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,73 tok/s TG
Prefill 560 · TTFT 40.628 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
20Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,46 tok/s TG
Prefill 568 · TTFT 39.939 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
21Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,89 tok/s TG
Prefill 409 · TTFT 24.788 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
22Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
55,85 tok/s TG
Prefill 415 · TTFT 24.406 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
23Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,39 tok/s TG
Prefill 5.909 · TTFT 412 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 126 GB RAMvLLMgodclaw
24Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
38,84 tok/s TG
Prefill 258 · TTFT 10.963 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
25Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,99 tok/s TG
Prefill 221 · TTFT 12.961 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
26Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,58 tok/s TG
Prefill 220 · TTFT 12.963 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
27Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,44 tok/s TG
Prefill 249 · TTFT 90.371 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
28Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,77 tok/s TG
Prefill 160 · TTFT 63.351 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
29Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,41 tok/s TG
Prefill 713 · TTFT 3.416 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
30Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,97 tok/s TG
Prefill 204 · TTFT 110.341 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
31Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,67 tok/s TG
Prefill 124 · TTFT 18.211 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
32Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,36 tok/s TG
Prefill 158 · TTFT 64.302 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
33Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,95 tok/s TG
Prefill 94 · TTFT 24.951 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD EPYC 7203P 8-Core Processor.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – AMD EPYC 7203P 8-Core Processor

HerstellerAMD
Beste Generation388,1 tok/s
Bester Prefill16.198 tok/s
Modelle3
Messläufe (Performance)33