Created bymario-alka.dePowered bynoob2claw.detricoma.de
Mistral AI

Mamba-Codestral-7B-v0.17B

Benchmark profile and published results.

Dense7B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation29,3 tok/s
Min 0,0Ø 245,7Max 3.484,3
Unter dem Durchschnitt · 4971 Systeme im Feld
Prefill327 tok/s
Min 4Ø 4.892Max 112.346
Unter dem Durchschnitt · 4953 Systeme im Feld
Time to First Token8.424 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

32,230,729,327,826,3308321334347Prefill (tok/s)Generation (tok/s)CPU-only - 29,3 tok/s Generation, 327 tok/s Prefill, TTFT 8.424 ms (1 Lauf)CPU-only
CPU-only 29,3 tok/s

CPUby processor

32,230,729,327,826,3308321334347Prefill (tok/s)Generation (tok/s)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) - 29,3 tok/s Generation, 327 tok/s Prefill, TTFT 8.424 ms (1 Lauf)Apple M6 (unified CPU...
Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) 29,3 tok/s

ENGby engine

32,230,729,327,826,3308321334347Prefill (tok/s)Generation (tok/s)lmstudio-mlx - 29,3 tok/s Generation, 327 tok/s Prefill, TTFT 8.424 ms (1 Lauf)lmstudio-mlx
lmstudio-mlx 29,3 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Mamba-Codestral-7B-v0.17BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,25 tok/s TG
Prefill 327 · TTFT 8.424 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.