Can a RK3588 (unspecified board) run Granite 4.2 3B?
Yes, usably. Best reported generation speed: 9.3 tokens/s on RK3588 (unspecified board) (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), per happyme531 (open_rknpu2_lm_infer README). Boards tested: RK3588 (unspecified board).
Granite 4.2 3B speed by board
- RK3588 (unspecified board): 9.3 tokens/s best (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), 2 tests
FAQ
Which edge board runs Granite 4.2 3B fastest?
Of the boards tested, RK3588 (unspecified board) is fastest for Granite 4.2 3B: 9.3 tokens/s generation (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)).
How fast does Granite 4.2 3B run on RK3588 (unspecified board)?
Best reported generation speed for Granite 4.2 3B on RK3588 (unspecified board) is 9.3 tokens/s (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), from 2 sourced tests. Source: happyme531 (open_rknpu2_lm_infer README) (https://github.com/happyme531/open_rknpu2_lm_infer#performance).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| RK3588 (unspecified board) | Granite 4.2 3B3B params · W4A8 mixed (QQQ-Rot) | open_rknpu2_lm_infer v0.6.1 (NPU) | 9.3prompt 182.5 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README)2026-10-20 |
| RK3588 (unspecified board) | Granite 4.2 3B3B params · W8A8 | rknn-llm 1.3.1 (NPU, vendor SDK) | 6.8prompt 120.5 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README, vendor baseline)2026-10-20 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).