Mistral AI
Mamba-Codestral-7B-v0.17B
Benchmark profile and published results.
Dense7B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation29,3 tok/s
Min 0,0Ø 28,7Max 298,1
Ueber dem Durchschnitt · 138 Systeme im Feld
Prefill327 tok/s
Min 4Ø 1.009Max 14.858
Unter dem Durchschnitt · 138 Systeme im Feld
Time to First Token8.424 ms
Min 175Ø 93.316Max 506.953
Ueber dem Durchschnitt · 138 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Mamba-Codestral-7B-v0.17BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,25 tok/s TG Prefill 327 · TTFT 8.424 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.

