Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🧮
Mainboard

Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series)

Other1 CPU222 Benchmarks⚡ 10 W Idle
CPUs
1
Modelle
49
Benchmarks
222
Beste Generation
1.492,8 tok/s
🏆
gemma-4-E2B-it läuft am schnellsten auf diesem Board · 1.492,8 tok/s
49 Modelle mit Performance-Daten getestet

Top-Modelle nach Token-Generierung

Bester gemessener Generierungs-Durchsatz je Modell auf Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) (tok/s) – klicken für Leaderboard-Filter.

gemma-4-E2B-it5B
1.492,8 tok/s
gpt-oss-20b20B
1.113,5 tok/s
Nemotron-3-Nano-4B4B
992,1 tok/s
Laguna-XS-2.1
986,1 tok/s
gemma-4-E4B-it8B
983,7 tok/s
North-Mini-Code-1.0
939,5 tok/s
Qwen3-30B-A3B-Thinking-250730B
930,6 tok/s
Qwen3-Coder-30B-A3B-Instruct30B
928,5 tok/s
Qwen3-Omni-30B-A3B-Thinking30B
927,4 tok/s
Gemma-4-26B-A4B-it26B
926,2 tok/s
Ornith-1.0-35B35B
920,2 tok/s
Qwen3-30B-A3B-Instruct-250730B
905,1 tok/s
Anzeige
Modell-Vergleich

Getestete Modelle im Vergleich

Jede Blase ist ein Modell auf Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) – Position: Prompt-Verarbeitung (X) × Ausgabe-Geschwindigkeit (Y), Blasengröße: Anzahl Messläufe. Naeher an der oberen rechten Ecke = schneller.

MODnach Modell

1.9401.4559704850,004.1248.24812.372Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.492,8 tok/s Generation, 9.978 tok/s Prefill, TTFT 3.182 ms (3 Laufe)gemma-4-E2B-itgpt-oss-20b - 1.113,5 tok/s Generation, 6.303 tok/s Prefill, TTFT 4.194 ms (18 Laufe)gpt-oss-20bNemotron-3-Nano-4B - 992,1 tok/s Generation, 5.129 tok/s Prefill, TTFT 5.537 ms (3 Laufe)Nemotron-3-Nano-4BLaguna-XS-2.1 - 986,1 tok/s Generation, 4.490 tok/s Prefill, TTFT 6.230 ms (9 Laufe)Laguna-XS-2.1gemma-4-E4B-it - 983,7 tok/s Generation, 6.659 tok/s Prefill, TTFT 4.857 ms (3 Laufe)gemma-4-E4B-itNorth-Mini-Code-1.0 - 939,5 tok/s Generation, 4.130 tok/s Prefill, TTFT 5.948 ms (3 Laufe)North-Mini-Code-1.0Qwen3-30B-A3B-Thinking-2507 - 930,6 tok/s Generation, 7.726 tok/s Prefill, TTFT 5.880 ms (6 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-Coder-30B-A3B-Instruct - 928,5 tok/s Generation, 9.749 tok/s Prefill, TTFT 3.637 ms (6 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-Omni-30B-A3B-Thinking - 927,4 tok/s Generation, 4.493 tok/s Prefill, TTFT 6.216 ms (3 Laufe)Qwen3-Omni-30B-A3B-Th...Gemma-4-26B-A4B-it - 926,2 tok/s Generation, 3.620 tok/s Prefill, TTFT 6.478 ms (3 Laufe)Gemma-4-26B-A4B-itOrnith-1.0-35B - 920,2 tok/s Generation, 3.340 tok/s Prefill, TTFT 6.459 ms (3 Laufe)Ornith-1.0-35BQwen3-30B-A3B-Instruct-2507 - 905,1 tok/s Generation, 8.498 tok/s Prefill, TTFT 5.639 ms (6 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-VL-30B-A3B-Instruct - 903,5 tok/s Generation, 5.934 tok/s Prefill, TTFT 5.817 ms (3 Laufe)Qwen3-VL-30B-A3B-Inst...Nemotron-Cascade-2-30B-A3B - 897,5 tok/s Generation, 3.962 tok/s Prefill, TTFT 6.439 ms (3 Laufe)Nemotron-Cascade-2-30...Nemotron-3-Nano-30B-A3B - 897,5 tok/s Generation, 3.908 tok/s Prefill, TTFT 6.463 ms (3 Laufe)Nemotron-3-Nano-30B-A...Nemotron-3-Nano-Omni-30B-A3B-Reasoning - 896,6 tok/s Generation, 3.860 tok/s Prefill, TTFT 6.490 ms (3 Laufe)Nemotron-3-Nano-Omni-...Qwen3.5-35B-A3B - 866,1 tok/s Generation, 3.371 tok/s Prefill, TTFT 6.651 ms (3 Laufe)Qwen3.5-35B-A3BQwen3.6-35B-A3B - 852,0 tok/s Generation, 3.431 tok/s Prefill, TTFT 6.717 ms (3 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 849,2 tok/s Generation, 3.458 tok/s Prefill, TTFT 6.729 ms (3 Laufe)Qwen-AgentWorld-35B-A...Meta-Llama-3.1-8B-Instruct - 837,9 tok/s Generation, 8.047 tok/s Prefill, TTFT 5.721 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Ornith-1.0-9B - 786,2 tok/s Generation, 4.419 tok/s Prefill, TTFT 6.463 ms (3 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 654,9 tok/s Generation, 2.617 tok/s Prefill, TTFT 8.920 ms (3 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 543,1 tok/s Generation, 4.926 tok/s Prefill, TTFT 5.681 ms (6 Laufe)Ministral-3-14B-Reaso...Magistral-Small-2509 - 353,8 tok/s Generation, 1.856 tok/s Prefill, TTFT 4.508 ms (6 Laufe)Magistral-Small-2509Devstral-Small-2-24B-Instruct-2512 - 331,6 tok/s Generation, 3.668 tok/s Prefill, TTFT 14.010 ms (3 Laufe)Devstral-Small-2-24B-...Codestral-22B-v0.1 - 325,2 tok/s Generation, 2.907 tok/s Prefill, TTFT 14.580 ms (3 Laufe)Codestral-22B-v0.1Devstral-Small-2507 - 317,4 tok/s Generation, 4.619 tok/s Prefill, TTFT 10.835 ms (3 Laufe)Devstral-Small-2507Qwen3.6-27B - 264,2 tok/s Generation, 1.458 tok/s Prefill, TTFT 19.358 ms (3 Laufe)Qwen3.6-27BOpenReasoning-Nemotron-32B - 236,8 tok/s Generation, 2.036 tok/s Prefill, TTFT 20.847 ms (3 Laufe)OpenReasoning-Nemotro...Qwen2.5-Coder-32B-Instruct - 236,4 tok/s Generation, 2.040 tok/s Prefill, TTFT 20.899 ms (3 Laufe)Qwen2.5-Coder-32B-Ins...Qwen2.5-32B-Instruct-AWQ - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)Qwen2.5-32B-Instruct-...Seed-OSS-36B-Instruct - 111,6 tok/s Generation, 992 tok/s Prefill, TTFT 41.392 ms (3 Laufe)Seed-OSS-36B-Instructgpt-oss-120b - 85,3 tok/s Generation, 238 tok/s Prefill, TTFT 79.784 ms (3 Laufe)gpt-oss-120bQwen3-Coder-Next - 78,2 tok/s Generation, 310 tok/s Prefill, TTFT 81.109 ms (3 Laufe)Qwen3-Coder-NextMistral-Small-4-119B-2603 - 58,5 tok/s Generation, 258 tok/s Prefill, TTFT 109.712 ms (3 Laufe)Mistral-Small-4-119B-...Laguna-S-2.1-INT4 - 32,8 tok/s Generation, 163 tok/s Prefill, TTFT 131.427 ms (6 Laufe)Laguna-S-2.1-INT4Qwen3.5-122B-A10B - 24,9 tok/s Generation, 129 tok/s Prefill, TTFT 137.609 ms (3 Laufe)Qwen3.5-122B-A10BGLM-4.5-Air - 20,8 tok/s Generation, 137 tok/s Prefill, TTFT 156.298 ms (3 Laufe)GLM-4.5-AirLlama-3.3-Nemotron-Super-49B-v1.5 - 19,6 tok/s Generation, 407 tok/s Prefill, TTFT 91.059 ms (3 Laufe)Llama-3.3-Nemotron-Su...gemma-4-31B-it - 19,5 tok/s Generation, 339 tok/s Prefill, TTFT 80.766 ms (1 Lauf)gemma-4-31B-itNemotron-3-Super-120B-A12B - 18,9 tok/s Generation, 106 tok/s Prefill, TTFT 171.396 ms (3 Laufe)Nemotron-3-Super-120B...Nemotron-H-47B-Reasoning-128K - 16,9 tok/s Generation, 215 tok/s Prefill, TTFT 138.108 ms (3 Laufe)Nemotron-H-47B-Reason...MiniMax-M2.5 - 15,9 tok/s Generation, 126 tok/s Prefill, TTFT 133.611 ms (6 Laufe)MiniMax-M2.5Qwen2.5-72B-Instruct - 4,9 tok/s Generation, 209 tok/s Prefill, TTFT 31.676 ms (3 Laufe)Qwen2.5-72B-Instructcommand-a-reasoning-08-2025 - 4,2 tok/s Generation, 90 tok/s Prefill, TTFT 72.246 ms (3 Laufe)command-a-reasoning-0...MiniMax-M2.7 - 4,0 tok/s Generation, 10 tok/s Prefill, TTFT 346.143 ms (3 Laufe)MiniMax-M2.7Laguna-M.1 - 3,1 tok/s Generation, 6 tok/s Prefill, TTFT 392.752 ms (35 Laufe)Laguna-M.1Devstral-2-123B-Instruct-2512 - 2,9 tok/s Generation, 129 tok/s Prefill, TTFT 54.597 ms (3 Laufe)Devstral-2-123B-Instr...Mistral-Medium-3.5-128B - 2,8 tok/s Generation, 116 tok/s Prefill, TTFT 59.662 ms (3 Laufe)Mistral-Medium-3.5-12...
gemma-4-E2B-it 1.492,8 tok/sgpt-oss-20b 1.113,5 tok/sNemotron-3-Nano-4B 992,1 tok/sLaguna-XS-2.1 986,1 tok/sgemma-4-E4B-it 983,7 tok/sNorth-Mini-Code-1.0 939,5 tok/sQwen3-30B-A3B-Thinking-2507 930,6 tok/sQwen3-Coder-30B-A3B-Instruct 928,5 tok/sQwen3-Omni-30B-A3B-Thinking 927,4 tok/sGemma-4-26B-A4B-it 926,2 tok/sOrnith-1.0-35B 920,2 tok/sQwen3-30B-A3B-Instruct-2507 905,1 tok/sQwen3-VL-30B-A3B-Instruct 903,5 tok/sNemotron-Cascade-2-30B-A3B 897,5 tok/sNemotron-3-Nano-30B-A3B 897,5 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 896,6 tok/sQwen3.5-35B-A3B 866,1 tok/sQwen3.6-35B-A3B 852,0 tok/sQwen-AgentWorld-35B-A3B 849,2 tok/sMeta-Llama-3.1-8B-Instruct 837,9 tok/sOrnith-1.0-9B 786,2 tok/sgemma-4-12B-it 654,9 tok/sMinistral-3-14B-Reasoning-2512 543,1 tok/sMagistral-Small-2509 353,8 tok/sDevstral-Small-2-24B-Instruct-2512 331,6 tok/sCodestral-22B-v0.1 325,2 tok/sDevstral-Small-2507 317,4 tok/sQwen3.6-27B 264,2 tok/sOpenReasoning-Nemotron-32B 236,8 tok/sQwen2.5-Coder-32B-Instruct 236,4 tok/sQwen2.5-32B-Instruct-AWQ 223,8 tok/sSeed-OSS-36B-Instruct 111,6 tok/sgpt-oss-120b 85,3 tok/sQwen3-Coder-Next 78,2 tok/sMistral-Small-4-119B-2603 58,5 tok/sLaguna-S-2.1-INT4 32,8 tok/sQwen3.5-122B-A10B 24,9 tok/sGLM-4.5-Air 20,8 tok/sLlama-3.3-Nemotron-Super-49B-v1.5 19,6 tok/sgemma-4-31B-it 19,5 tok/sNemotron-3-Super-120B-A12B 18,9 tok/sNemotron-H-47B-Reasoning-128K 16,9 tok/sMiniMax-M2.5 15,9 tok/sQwen2.5-72B-Instruct 4,9 tok/scommand-a-reasoning-08-2025 4,2 tok/sMiniMax-M2.7 4,0 tok/sLaguna-M.1 3,1 tok/sDevstral-2-123B-Instruct-2512 2,9 tok/sMistral-Medium-3.5-128B 2,8 tok/s

Prozessoren auf diesem Board

CPUAMD Ryzen 9 8945HX with Radeon GraphicsAMD · 222 Läufe1.492,8 tok/s

Grafikkarten auf diesem Board

GPUNVIDIA GeForce RTX 3090 TiNVIDIA · 222 Läufe1.492,8 tok/s

Getestete Modelle

Mgemma-4-E2B-it5BGoogle · 3 Läufe Mgpt-oss-20b20BOpenAI · 18 Läufe MNemotron-3-Nano-4B4BNVIDIA · 3 Läufe MLaguna-XS-2.1Poolside · 9 Läufe Mgemma-4-E4B-it8BGoogle · 3 Läufe MNorth-Mini-Code-1.0Cohere · 3 Läufe MQwen3-30B-A3B-Thinking-250730BQwen (Alibaba) · 6 Läufe MQwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) · 6 Läufe MQwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) · 3 Läufe MGemma-4-26B-A4B-it26BGoogle · 3 Läufe MOrnith-1.0-35B35BDeepReinforce · 3 Läufe MQwen3-30B-A3B-Instruct-250730BQwen (Alibaba) · 6 Läufe MQwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) · 3 Läufe MNemotron-3-Nano-30B-A3B30BNVIDIA · 3 Läufe MNemotron-Cascade-2-30B-A3B30BNVIDIA · 3 Läufe MNemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA · 3 Läufe MQwen3.5-35B-A3B35BQwen (Alibaba) · 3 Läufe MQwen3.6-35B-A3B35BQwen (Alibaba) · 3 Läufe MQwen-AgentWorld-35B-A3B35BQwen (Alibaba) · 3 Läufe MMeta-Llama-3.1-8B-Instruct8BMeta · 3 Läufe MOrnith-1.0-9B9BDeepReinforce · 3 Läufe Mgemma-4-12B-it12BGoogle · 3 Läufe MMinistral-3-14B-Reasoning-251214BMistral AI · 6 Läufe MMagistral-Small-250924BMistral AI · 6 Läufe MDevstral-Small-2-24B-Instruct-251224BMistral AI · 3 Läufe MCodestral-22B-v0.122BMistral AI · 3 Läufe MDevstral-Small-250724BMistral AI · 3 Läufe MQwen3.6-27B27BQwen (Alibaba) · 3 Läufe MOpenReasoning-Nemotron-32B32BNVIDIA · 3 Läufe MQwen2.5-Coder-32B-Instruct32BQwen (Alibaba) · 3 Läufe MQwen2.5-32B-Instruct-AWQ32BQwen (Alibaba) · 6 Läufe MSeed-OSS-36B-Instruct36BByteDance Seed · 3 Läufe Mgpt-oss-120b120BOpenAI · 3 Läufe MQwen3-Coder-NextQwen (Alibaba) · 3 Läufe MMistral-Small-4-119B-2603119BMistral AI · 3 Läufe MLaguna-S-2.1-INT4Poolside · 6 Läufe MQwen3.5-122B-A10B122BQwen (Alibaba) · 3 Läufe MGLM-4.5-Air106BZ.ai (Zhipu) · 3 Läufe MLlama-3.3-Nemotron-Super-49B-v1.549BNVIDIA · 3 Läufe Mgemma-4-31B-it31BGoogle · 1 Läufe MNemotron-3-Super-120B-A12B120BNVIDIA · 3 Läufe MNemotron-H-47B-Reasoning-128K47BNVIDIA · 3 Läufe MMiniMax-M2.5230BMiniMax · 6 Läufe MQwen2.5-72B-Instruct72BQwen (Alibaba) · 3 Läufe Mcommand-a-reasoning-08-2025111BCohere · 3 Läufe MMiniMax-M2.7230BMiniMax · 3 Läufe MLaguna-M.1Poolside · 35 Läufe MDevstral-2-123B-Instruct-2512123BMistral AI · 3 Läufe MMistral-Medium-3.5-128B128BMistral AI · 3 Läufe
Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series).

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.492,78 tok/s TG
Prefill 11.476 · TTFT 7.075 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
2gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.113,51 tok/s TG
Prefill 6.554 · TTFT 10.391 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
3Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
992,11 tok/s TG
Prefill 5.920 · TTFT 12.083 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
4Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
986,05 tok/s TG
Prefill 5.179 · TTFT 13.058 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
5gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
983,68 tok/s TG
Prefill 7.362 · TTFT 10.840 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
6Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
981,72 tok/s TG
Prefill 5.166 · TTFT 13.134 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
7Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
979,74 tok/s TG
Prefill 5.175 · TTFT 13.143 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
8North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
939,51 tok/s TG
Prefill 4.611 · TTFT 12.995 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
9Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
930,61 tok/s TG
Prefill 5.307 · TTFT 13.161 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
10Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
928,48 tok/s TG
Prefill 7.663 · TTFT 12.219 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
11Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
927,42 tok/s TG
Prefill 5.040 · TTFT 13.415 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
12Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
926,20 tok/s TG
Prefill 3.875 · TTFT 14.083 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XLDetails →
13Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
920,16 tok/s TG
Prefill 3.818 · TTFT 13.771 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
14Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
905,10 tok/s TG
Prefill 7.532 · TTFT 12.527 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
15Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
903,53 tok/s TG
Prefill 7.168 · TTFT 12.726 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
16Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
901,86 tok/s TG
Prefill 12.965 · TTFT 12.663 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
17Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
897,47 tok/s TG
Prefill 4.560 · TTFT 13.829 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
18Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
897,46 tok/s TG
Prefill 4.457 · TTFT 13.871 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
19Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
896,55 tok/s TG
Prefill 4.436 · TTFT 13.922 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
20Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
883,71 tok/s TG
Prefill 12.981 · TTFT 12.917 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
21Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
866,12 tok/s TG
Prefill 3.825 · TTFT 14.245 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
22Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
851,97 tok/s TG
Prefill 3.890 · TTFT 14.433 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
23Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
849,15 tok/s TG
Prefill 3.913 · TTFT 14.486 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
24Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
837,85 tok/s TG
Prefill 9.559 · TTFT 12.952 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
25gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
827,28 tok/s TG
Prefill 9.803 · TTFT 2.242 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
26gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
797,18 tok/s TG
Prefill 11.820 · TTFT 1.789 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketDetails →
27gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
796,82 tok/s TG
Prefill 11.892 · TTFT 1.781 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketDetails →
28Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
786,22 tok/s TG
Prefill 4.926 · TTFT 14.292 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
29Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
670,65 tok/s TG
Prefill 17.357 · TTFT 3.808 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
30gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
656,13 tok/s TG
Prefill 5.934 · TTFT 3.387 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
31gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
654,86 tok/s TG
Prefill 2.799 · TTFT 19.412 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XLDetails →
32Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
596,31 tok/s TG
Prefill 5.389 · TTFT 4.001 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
33Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
586,52 tok/s TG
Prefill 4.479 · TTFT 4.845 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
34Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
584,39 tok/s TG
Prefill 4.467 · TTFT 4.864 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
35Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
582,20 tok/s TG
Prefill 4.480 · TTFT 4.869 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
36Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
558,18 tok/s TG
Prefill 4.694 · TTFT 4.497 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
37Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
556,41 tok/s TG
Prefill 4.468 · TTFT 4.620 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
38Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
554,75 tok/s TG
Prefill 7.036 · TTFT 3.930 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
39Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
550,00 tok/s TG
Prefill 3.904 · TTFT 4.878 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
40Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
548,84 tok/s TG
Prefill 4.012 · TTFT 4.835 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
41Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
547,85 tok/s TG
Prefill 3.914 · TTFT 4.883 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
42Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,05 tok/s TG
Prefill 4.878 · TTFT 20.084 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
43North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,97 tok/s TG
Prefill 4.226 · TTFT 4.294 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
44Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,88 tok/s TG
Prefill 6.558 · TTFT 4.129 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
45gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,58 tok/s TG
Prefill 6.522 · TTFT 3.407 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
46Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,30 tok/s TG
Prefill 6.912 · TTFT 4.026 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
47Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
524,37 tok/s TG
Prefill 7.751 · TTFT 4.130 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
48Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
522,97 tok/s TG
Prefill 3.432 · TTFT 4.794 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XLDetails →
49Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
517,07 tok/s TG
Prefill 3.355 · TTFT 4.929 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
50Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
496,79 tok/s TG
Prefill 12.291 · TTFT 3.700 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
51Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
487,24 tok/s TG
Prefill 12.271 · TTFT 3.758 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
52gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
483,69 tok/s TG
Prefill 9.270 · TTFT 1.070 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketDetails →
53gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
479,47 tok/s TG
Prefill 9.242 · TTFT 1.075 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketDetails →
54Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
479,14 tok/s TG
Prefill 3.365 · TTFT 5.049 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
55Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
472,34 tok/s TG
Prefill 3.434 · TTFT 5.070 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
56Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
471,29 tok/s TG
Prefill 3.464 · TTFT 5.057 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
57gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
470,17 tok/s TG
Prefill 6.563 · TTFT 3.093 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
58gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
468,74 tok/s TG
Prefill 6.617 · TTFT 3.069 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
59gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
463,67 tok/s TG
Prefill 5.822 · TTFT 1.705 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
60Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
456,70 tok/s TG
Prefill 8.966 · TTFT 3.773 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
61Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
430,04 tok/s TG
Prefill 4.493 · TTFT 4.596 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
62gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
403,67 tok/s TG
Prefill 5.727 · TTFT 1.727 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
63Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
399,08 tok/s TG
Prefill 14.492 · TTFT 984 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
64gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
355,09 tok/s TG
Prefill 2.494 · TTFT 6.574 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XLDetails →
65Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
353,84 tok/s TG
Prefill 924 · TTFT 13.139 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
66Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
338,30 tok/s TG
Prefill 5.943 · TTFT 2.299 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
67Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
331,64 tok/s TG
Prefill 4.743 · TTFT 31.297 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
68Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
330,94 tok/s TG
Prefill 4.379 · TTFT 7.353 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
69Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,20 tok/s TG
Prefill 3.507 · TTFT 31.980 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
70Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
317,44 tok/s TG
Prefill 6.072 · TTFT 23.382 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
71Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
294,82 tok/s TG
Prefill 4.538 · TTFT 6.199 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
72Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
264,22 tok/s TG
Prefill 1.610 · TTFT 42.712 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
73gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
246,06 tok/s TG
Prefill 5.285 · TTFT 374 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
74gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
245,58 tok/s TG
Prefill 5.520 · TTFT 359 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
75gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,87 tok/s TG
Prefill 5.096 · TTFT 388 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
76Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,91 tok/s TG
Prefill 4.079 · TTFT 528 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
77OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,79 tok/s TG
Prefill 2.409 · TTFT 46.406 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
78Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,42 tok/s TG
Prefill 2.420 · TTFT 46.503 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
79gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
235,80 tok/s TG
Prefill 8.654 · TTFT 230 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
80Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,20 tok/s TG
Prefill 2.929 · TTFT 4.189 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series).

Im Leaderboard →
Noch keine Harnessbenchmarks auf diesem Mainboard.

← Alle Hardware