Can a Raspberry Pi 5 run Qwen2.5 0.5B Instruct?
Yes, usably. Best reported generation speed: 33.8 tokens/s on Raspberry Pi 5 (Q4_0, llama.cpp (CPU)), per llama.cpp discussion #30069 author. Boards tested: Raspberry Pi 5.
Qwen2.5 0.5B Instruct speed by board
- Raspberry Pi 5: 33.8 tokens/s best (Q4_0, llama.cpp (CPU)), 1 test
FAQ
Which edge board runs Qwen2.5 0.5B Instruct fastest?
Of the boards tested, Raspberry Pi 5 is fastest for Qwen2.5 0.5B Instruct: 33.8 tokens/s generation (Q4_0, llama.cpp (CPU)).
How fast does Qwen2.5 0.5B Instruct run on Raspberry Pi 5?
Best reported generation speed for Qwen2.5 0.5B Instruct on Raspberry Pi 5 is 33.8 tokens/s (Q4_0, llama.cpp (CPU)), from 1 sourced test. Source: llama.cpp discussion #30069 author (https://github.com/ggml-org/llama.cpp/discussions/30069).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 52 GB RAM | Qwen2.5 0.5B Instruct0.63B params · Q4_0 | llama.cpp (CPU) | 33.8prompt 173.7 t/s | ₹7,287 Buy4.64 t/s per ₹1k | Community llama.cpp discussion #30069 author2026-10-06 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).