MiniCPM-V 4.6 (Q4)
Measured across 1 chip under the standard preset.
| Device | Chip | Model | Quant | Runtime | Ctx | TTFT | Decode | Peak RAM | Source |
|---|---|---|---|---|---|---|---|---|---|
| Galaxy S21 Ultrasamsung SM-G998B | exynos2100 | MiniCPM-V 4.6 (Q4) | Q4_K_M | gguf/cpu | 4096 | 2.30s | 23.5 t/s | 1.5 GB | community |
Measured across 1 chip under the standard preset.
| Device | Chip | Model | Quant | Runtime | Ctx | TTFT | Decode | Peak RAM | Source |
|---|---|---|---|---|---|---|---|---|---|
| Galaxy S21 Ultrasamsung SM-G998B | exynos2100 | MiniCPM-V 4.6 (Q4) | Q4_K_M | gguf/cpu | 4096 | 2.30s | 23.5 t/s | 1.5 GB | community |