HuggingFaceTB
SmolLM2-1.7B-Instruct1.7B
Benchmark profile and published results.
Dense1.7B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation531,7 tok/s
Min 0,1Ø 159,1Max 717,6
Ueber dem Durchschnitt · 361 Systeme im Feld
Prefill44.141 tok/s
Min 39Ø 5.819Max 52.503
Ueber dem Durchschnitt · 361 Systeme im Feld
Time to First Token223 ms
Min 156Ø 18.353Max 354.928
Ueber dem Durchschnitt · 361 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
CPUby processor
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 531,74 tok/s TG Prefill 44.141 · TTFT 1.002 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 2 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 338,72 tok/s TG Prefill 33.135 · TTFT 574 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 3 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,05 tok/s TG Prefill 13.702 · TTFT 223 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 4 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,97 tok/s TG Prefill 2.966 · TTFT 1.194 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAM | Ollamaopenclaw_cliQ8_0 | Details → | |
| 5 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,49 tok/s TG Prefill 4.031 · TTFT 886 ms | 1× | Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAM | lmstudio-mlxlmstudioMLX bf16 | Details → | |
| 6 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,10 tok/s TG Prefill 45 · TTFT 281.637 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 7 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,89 tok/s TG Prefill 38 · TTFT 81.741 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.

