Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Google

Gemma-4-26B-A4B26B

Benchmark profile and published results.

MoE26B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX A6000All GPUs
Generation264,1 tok/s
Min 5,0Ø 252,9Max 1.568,0
Ueber dem Durchschnitt · 992 Systeme im Feld
Prefill4.537 tok/s
Min 172Ø 8.649Max 55.260
Unter dem Durchschnitt · 992 Systeme im Feld
Time to First Token494 ms
Min 117Ø 4.699Max 124.920
Ueber dem Durchschnitt · 992 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

33425016783,50,04.0504.2504.4504.651Prefill (tok/s)Generation (tok/s)NVIDIA RTX A6000 - 264,1 tok/s Generation, 4.323 tok/s Prefill, TTFT 2.385 ms (6 Laufe)NVIDIA RTX A6000NVIDIA GB10 - 47,1 tok/s Generation, 4.378 tok/s Prefill, TTFT 451 ms (1 Lauf)NVIDIA GB10
NVIDIA RTX A6000 264,1 tok/sNVIDIA GB10 47,1 tok/s

CPUby processor

33425016783,50,04.0504.2504.4504.651Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 264,1 tok/s Generation, 4.323 tok/s Prefill, TTFT 2.385 ms (6 Laufe)AMD Ryzen Threadrippe...NVIDIA Grace - 47,1 tok/s Generation, 4.378 tok/s Prefill, TTFT 451 ms (1 Lauf)NVIDIA Grace
AMD Ryzen Threadripper PRO 7955WX 16-Cores 264,1 tok/sNVIDIA Grace 47,1 tok/s

ENGby engine

33425016783,50,04.0504.2504.4504.651Prefill (tok/s)Generation (tok/s)llama.cpp - 264,1 tok/s Generation, 4.323 tok/s Prefill, TTFT 2.385 ms (6 Laufe)llama.cppvLLM - 47,1 tok/s Generation, 4.378 tok/s Prefill, TTFT 451 ms (1 Lauf)vLLM
llama.cpp 264,1 tok/svLLM 47,1 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
264,08 tok/s TG
Prefill 4.424 · TTFT 4.475 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
2Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,28 tok/s TG
Prefill 4.432 · TTFT 4.464 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
3Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,09 tok/s TG
Prefill 4.516 · TTFT 2.194 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
4Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
169,09 tok/s TG
Prefill 4.537 · TTFT 2.184 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
5Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,58 tok/s TG
Prefill 4.000 · TTFT 499 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
6Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,33 tok/s TG
Prefill 4.028 · TTFT 494 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
7Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,06 tok/s TG
Prefill 4.378 · TTFT 451 ms
1×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4Details →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.