Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Z.ai (Zhipu)

glm-5.2-colibri744B

Benchmark profile and published results.

MoE744B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Workstation EditionAll GPUs
Generation0,0 tok/s
Min 0,0Ø 518,2Max 2.414,4
Unter dem Durchschnitt · 244 Systeme im Feld
Prefill211 tok/s
Min 7Ø 6.972Max 39.029
Unter dem Durchschnitt · 244 Systeme im Feld
Time to First Token10.045 ms
Min 114Ø 27.182Max 354.674
Ueber dem Durchschnitt · 244 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

0,00,00,00,00,0140146152157Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 0,0 tok/s Generation, 149 tok/s Prefill, TTFT 73.893 ms (9 Laufe)NVIDIA RTX PRO 6000 B...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 0,0 tok/s

CPUby processor

0,00,00,00,00,0140146152157Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 0,0 tok/s Generation, 149 tok/s Prefill, TTFT 73.893 ms (9 Laufe)AMD Ryzen 9 9950X 16-...
AMD Ryzen 9 9950X 16-Core Processor 0,0 tok/s

ENGby engine

0,00,00,00,00,045102160218Prefill (tok/s)Generation (tok/s)vLLM - 0,0 tok/s Generation, 184 tok/s Prefill, TTFT 10.251 ms (4 Laufe)vLLMunbekannt - 0,0 tok/s Generation, 186 tok/s Prefill, TTFT 10.122 ms (2 Laufe)unbekanntcolibri - 0,0 tok/s Generation, 76 tok/s Prefill, TTFT 201.264 ms (3 Laufe)colibri
vLLM 0,0 tok/sunbekannt 0,0 tok/scolibri 0,0 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
2glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.057 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclawDetails →
3glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.045 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
4glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 188 · TTFT 10.056 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
5glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 174 · TTFT 10.848 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
6glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 185 · TTFT 10.186 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMgodclawDetails →
7glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 7 · TTFT 354.674 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibriINT4Details →
8glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 211 · TTFT 10.088 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibriINT4Details →
9glm-5.2-colibri744BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 10 · TTFT 239.030 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation Edition iAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMcolibricolibriDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.