Mistral AI
Mistral-Small-24B-Instruct-250123.6B
Benchmark profile and published results.
Dense23.6B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation153,1 tok/s
Min 0,0Ø 245,7Max 3.484,3
Unter dem Durchschnitt · 4971 Systeme im Feld
Prefill4.348 tok/s
Min 4Ø 4.892Max 112.346
Unter dem Durchschnitt · 4953 Systeme im Feld
Time to First Token1.390 ms
Min 20Ø 31.420Max 535.235
Ueber dem Durchschnitt · 4968 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
CPUby processor
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,12 tok/s TG Prefill 4.348 · TTFT 7.017 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,87 tok/s TG Prefill 3.428 · TTFT 3.916 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,51 tok/s TG Prefill 1.549 · TTFT 1.390 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,90 tok/s TG Prefill 266 · TTFT 8.275 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX 4bit | Details → | |
| 5 | Mistral-Small-24B-Instruct-250123.6BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,47 tok/s TG Prefill 226 · TTFT 10.329 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.

