Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🧠
Processor

Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz

Intel
39Benchmarks
16Models
39Performance
0Harness
25 WIdle power
115 WMax power
Best generation
259,9 tok/s
Qwen2.5-3B-Instruct
∅ Generation
75,1 tok/s
Schnitt aus 39 Läufen
Best prefill
9.775 tok/s
Prompt processing
Best TTFT
569 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Qwen2.5-3B-Instruct läuft am schnellsten auf dieser CPU · 259,9 tok/s
Bester Prefill: 9.775 tok/s · 16 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz – umschaltbar nach Generation, Prefill oder Kombiwert.

Qwen2.5-3B-Instruct3B
259,9 tok/s
Llama-3.2-3B-Instruct3B
226,6 tok/s
Meta-Llama-3.1-8B-Instruct8B
169,0 tok/s
Qwen2.5-7B-Instruct7B
160,3 tok/s
gemma-4-E2B-it5B
54,7 tok/s
Qwen3.6-35B-A3B35B
27,5 tok/s
Nemotron-3-Nano-30B-A3B30B
15,1 tok/s
Qwen3.5-122B-A10B122B
7,1 tok/s
gpt-oss-120b120B
6,8 tok/s
GLM-4.5-Air106B
4,2 tok/s
Performance profile

Durchsatz auf Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

33825316984,40,002.8635.7258.588Prefill (tok/s)Generation (tok/s)Qwen2.5-3B-Instruct - 259,9 tok/s Generation, 6.911 tok/s Prefill, TTFT 1.971 ms (6 Laufe)Qwen2.5-3B-InstructLlama-3.2-3B-Instruct - 226,6 tok/s Generation, 6.927 tok/s Prefill, TTFT 2.004 ms (6 Laufe)Llama-3.2-3B-InstructMeta-Llama-3.1-8B-Instruct - 169,0 tok/s Generation, 2.165 tok/s Prefill, TTFT 9.132 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Qwen2.5-7B-Instruct - 160,3 tok/s Generation, 3.649 tok/s Prefill, TTFT 3.816 ms (3 Laufe)Qwen2.5-7B-Instructgemma-4-E2B-it - 54,7 tok/s Generation, 3.248 tok/s Prefill, TTFT 2.994 ms (3 Laufe)gemma-4-E2B-itQwen3.6-35B-A3B - 27,5 tok/s Generation, 62 tok/s Prefill, TTFT 180.818 ms (3 Laufe)Qwen3.6-35B-A3BNemotron-3-Nano-30B-A3B - 15,1 tok/s Generation, 36 tok/s Prefill, TTFT 283.946 ms (3 Laufe)Nemotron-3-Nano-30B-A...Qwen3.5-122B-A10B - 7,1 tok/s Generation, 8 tok/s Prefill, TTFT 236.831 ms (1 Lauf)Qwen3.5-122B-A10Bgpt-oss-120b - 6,8 tok/s Generation, 16 tok/s Prefill, TTFT 131.537 ms (1 Lauf)gpt-oss-120bGLM-4.5-Air - 4,2 tok/s Generation, 10 tok/s Prefill, TTFT 226.444 ms (1 Lauf)GLM-4.5-AirSeed-OSS-36B-Instruct - 3,4 tok/s Generation, 43 tok/s Prefill, TTFT 181.856 ms (2 Laufe)Seed-OSS-36B-InstructOpenReasoning-Nemotron-32B - 2,4 tok/s Generation, 45 tok/s Prefill, TTFT 186.332 ms (2 Laufe)OpenReasoning-Nemotro...Qwen2.5-72B-Instruct - 2,3 tok/s Generation, 81 tok/s Prefill, TTFT 569 ms (1 Lauf)Qwen2.5-72B-InstructQwen2.5-Coder-32B-Instruct - 2,3 tok/s Generation, 53 tok/s Prefill, TTFT 145.743 ms (2 Laufe)Qwen2.5-Coder-32B-Ins...Llama-3.3-Nemotron-Super-49B-v1.5 - 1,1 tok/s Generation, 21 tok/s Prefill, TTFT 117.641 ms (1 Lauf)Llama-3.3-Nemotron-Su...Nemotron-H-47B-Reasoning-128K - 1,1 tok/s Generation, 16 tok/s Prefill, TTFT 141.049 ms (1 Lauf)Nemotron-H-47B-Reason...
Qwen2.5-3B-Instruct 259,9 tok/sLlama-3.2-3B-Instruct 226,6 tok/sMeta-Llama-3.1-8B-Instruct 169,0 tok/sQwen2.5-7B-Instruct 160,3 tok/sgemma-4-E2B-it 54,7 tok/sQwen3.6-35B-A3B 27,5 tok/sNemotron-3-Nano-30B-A3B 15,1 tok/sQwen3.5-122B-A10B 7,1 tok/sgpt-oss-120b 6,8 tok/sGLM-4.5-Air 4,2 tok/sSeed-OSS-36B-Instruct 3,4 tok/sOpenReasoning-Nemotron-32B 2,4 tok/sQwen2.5-72B-Instruct 2,3 tok/sQwen2.5-Coder-32B-Instruct 2,3 tok/sLlama-3.3-Nemotron-Super-49B-v1.5 1,1 tok/sNemotron-H-47B-Reasoning-128K 1,1 tok/s

ENGnach Engine

3042592141701251.8582.3082.7583.208Prefill (tok/s)Generation (tok/s)llama.cpp - 259,9 tok/s Generation, 2.901 tok/s Prefill, TTFT 92.236 ms (36 Laufe)llama.cppvLLM - 169,0 tok/s Generation, 2.165 tok/s Prefill, TTFT 9.132 ms (3 Laufe)vLLM
llama.cpp 259,9 tok/svLLM 169,0 tok/s

GPUnach Grafikkarte

2862732602472342.6742.7882.9013.015Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 2060 - 259,9 tok/s Generation, 2.844 tok/s Prefill, TTFT 85.844 ms (39 Laufe)NVIDIA GeForce RTX 20...
NVIDIA GeForce RTX 2060 259,9 tok/s
Platform

Mainboards with this CPU

Auf diesen Boards wurde Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz gemessen – anklicken für Board-Details mit CPUs und Modellen.

🧮Dell Inc. PowerEdge R820Dell · 16 Modelle · 39 Läufe · bis 259,9 tok/s→
Throughput & latency

Performancebenchmark

39 veroeffentlichte Performance-Läufe auf Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
259,86 tok/s TG
Prefill 9.253 · TTFT 3.361 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
2Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,59 tok/s TG
Prefill 9.526 · TTFT 3.488 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
3Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
225,82 tok/s TG
Prefill 9.739 · TTFT 3.277 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
4Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
215,97 tok/s TG
Prefill 9.775 · TTFT 3.283 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
5Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,50 tok/s TG
Prefill 6.698 · TTFT 2.090 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
6Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
173,08 tok/s TG
Prefill 7.158 · TTFT 2.024 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
7Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,96 tok/s TG
Prefill 3.010 · TTFT 18.082 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
8Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,19 tok/s TG
Prefill 7.879 · TTFT 1.850 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
9Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
160,26 tok/s TG
Prefill 4.979 · TTFT 6.510 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
10Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
158,90 tok/s TG
Prefill 7.616 · TTFT 1.908 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
11Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,88 tok/s TG
Prefill 2.387 · TTFT 7.059 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
12Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,79 tok/s TG
Prefill 3.816 · TTFT 3.796 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
13Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,40 tok/s TG
Prefill 3.776 · TTFT 651 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
14Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,62 tok/s TG
Prefill 3.646 · TTFT 677 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,93 tok/s TG
Prefill 4.119 · TTFT 596 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
16Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,69 tok/s TG
Prefill 3.840 · TTFT 645 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
17Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,51 tok/s TG
Prefill 1.097 · TTFT 2.256 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
18Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
56,92 tok/s TG
Prefill 2.151 · TTFT 1.142 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
19gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
54,70 tok/s TG
Prefill 3.624 · TTFT 5.459 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
20gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
50,91 tok/s TG
Prefill 3.620 · TTFT 2.732 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
21gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
37,14 tok/s TG
Prefill 2.500 · TTFT 791 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
22Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,51 tok/s TG
Prefill 79 · TTFT 326.271 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
23Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,06 tok/s TG
Prefill 56 · TTFT 178.109 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
24Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,35 tok/s TG
Prefill 51 · TTFT 38.075 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
25Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,11 tok/s TG
Prefill 29 · TTFT 379.775 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
26Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,88 tok/s TG
Prefill 24 · TTFT 89.272 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
27Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,07 tok/s TG
Prefill 8 · TTFT 236.831 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
28gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,79 tok/s TG
Prefill 16 · TTFT 131.537 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
29GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,18 tok/s TG
Prefill 10 · TTFT 226.444 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
30Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,44 tok/s TG
Prefill 39 · TTFT 317.771 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
31Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,22 tok/s TG
Prefill 54 · TTFT 382.793 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
32OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,44 tok/s TG
Prefill 39 · TTFT 324.717 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
33Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0
2,28 tok/s TG
Prefill 81 · TTFT 569 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
34Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,27 tok/s TG
Prefill 62 · TTFT 233.464 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
35Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,63 tok/s TG
Prefill 47 · TTFT 45.942 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
36OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,57 tok/s TG
Prefill 51 · TTFT 47.947 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
37Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,54 tok/s TG
Prefill 44 · TTFT 58.023 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
38Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,14 tok/s TG
Prefill 21 · TTFT 117.641 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
39Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,12 tok/s TG
Prefill 16 · TTFT 141.049 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz

HerstellerIntel
TDP115 W
Best generation259,9 tok/s
Best prefill9.775 tok/s
Models16
Messläufe (Performance)39