Can a RK3588 (unspecified board) run MiniCPM5 2B?
Yes, usably. Best reported generation speed: 13.2 tokens/s on RK3588 (unspecified board) (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), per happyme531 (open_rknpu2_lm_infer README). Boards tested: RK3588 (unspecified board).
MiniCPM5 2B speed by board
- RK3588 (unspecified board): 13.2 tokens/s best (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), 2 tests
FAQ
Which edge board runs MiniCPM5 2B fastest?
Of the boards tested, RK3588 (unspecified board) is fastest for MiniCPM5 2B: 13.2 tokens/s generation (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)).
How fast does MiniCPM5 2B run on RK3588 (unspecified board)?
Best reported generation speed for MiniCPM5 2B on RK3588 (unspecified board) is 13.2 tokens/s (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), from 2 sourced tests. Source: happyme531 (open_rknpu2_lm_infer README) (https://github.com/happyme531/open_rknpu2_lm_infer#performance).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| RK3588 (unspecified board) | MiniCPM5 2B2B params · W4A8 mixed (QQQ-Rot) | open_rknpu2_lm_infer v0.6.1 (NPU) | 13.2prompt 245.5 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README)2026-10-20 |
| RK3588 (unspecified board) | MiniCPM5 2B2B params · W8A8 | rknn-llm 1.3.1 (NPU, vendor SDK) | 9.4prompt 211.1 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README, vendor baseline)2026-10-20 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).