Can a RK3588 (unspecified board) run Qwen3 4B?
Yes, usably. Best reported generation speed: 10.5 tokens/s on RK3588 (unspecified board) (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), per happyme531 (open_rknpu2_lm_infer README). Boards tested: RK3588 (unspecified board).
Qwen3 4B speed by board
- RK3588 (unspecified board): 10.5 tokens/s best (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), 2 tests
FAQ
Which edge board runs Qwen3 4B fastest?
Of the boards tested, RK3588 (unspecified board) is fastest for Qwen3 4B: 10.5 tokens/s generation (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)).
How fast does Qwen3 4B run on RK3588 (unspecified board)?
Best reported generation speed for Qwen3 4B on RK3588 (unspecified board) is 10.5 tokens/s (W4A8 mixed (QQQ-Rot), open_rknpu2_lm_infer v0.6.1 (NPU)), from 2 sourced tests. Source: happyme531 (open_rknpu2_lm_infer README) (https://github.com/happyme531/open_rknpu2_lm_infer#performance).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| RK3588 (unspecified board) | Qwen3 4B4B params · W4A8 mixed (QQQ-Rot) | open_rknpu2_lm_infer v0.6.1 (NPU) | 10.5prompt 169.7 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README)2026-10-20 |
| RK3588 (unspecified board) | Qwen3 4B4B params · W8A8 | rknn-llm 1.3.1 (NPU, vendor SDK) | 5.8prompt 105.0 t/s | No India listing yet | Community happyme531 (open_rknpu2_lm_infer README, vendor baseline)2026-10-20 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).