Can a Orange Pi 5 Plus (RK3588) run Qwen2.5 3B?
Yes, usably. Best reported generation speed: 14.4 tokens/s on Orange Pi 5 Plus (RK3588) (W8A8, rknn-llm (NPU)), per jishuzhan.net author. Boards tested: Orange Pi 5 Plus (RK3588).
Qwen2.5 3B speed by board
- Orange Pi 5 Plus (RK3588): 14.4 tokens/s best (W8A8, rknn-llm (NPU)), 3 tests
FAQ
Which edge board runs Qwen2.5 3B fastest?
Of the boards tested, Orange Pi 5 Plus (RK3588) is fastest for Qwen2.5 3B: 14.4 tokens/s generation (W8A8, rknn-llm (NPU)).
How fast does Qwen2.5 3B run on Orange Pi 5 Plus (RK3588)?
Best reported generation speed for Qwen2.5 3B on Orange Pi 5 Plus (RK3588) is 14.4 tokens/s (W8A8, rknn-llm (NPU)), from 3 sourced tests. Source: jishuzhan.net author (https://jishuzhan.net/article/2099289570509246466).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · W8A8 | rknn-llm (NPU)NVMe data disk (/mnt/nvme) | 14.4prompt 284.0 t/s | ₹84,864 Buy0.17 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · Q4_0 | llama.cpp CPUNVMe data disk (/mnt/nvme) | 4.7prompt 25.0 t/s | ₹84,864 Buy0.06 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · Q4_0 | llama.cpp NPU forkNVMe data disk (/mnt/nvme) | 4.2prompt 230.0 t/s | ₹84,864 Buy0.05 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).