Can a Raspberry Pi 5 run Qwen3.5 4B?
Qwen3.5 4B speed by board
- Raspberry Pi 5: 2.4 tokens/s best (Q8_0, llama.cpp (llama-bench, --mmap 0)), 1 test
- Raspberry Pi 4: 1.1 tokens/s best (Ollama (CPU only, qwen3.5:4b default tag)), 1 test
FAQ
Which edge board runs Qwen3.5 4B fastest?
Of the boards tested, Raspberry Pi 5 is fastest for Qwen3.5 4B: 2.4 tokens/s generation (Q8_0, llama.cpp (llama-bench, --mmap 0)). Next is Raspberry Pi 4 at 1.1 tokens/s.
How fast does Qwen3.5 4B run on Raspberry Pi 5?
Best reported generation speed for Qwen3.5 4B on Raspberry Pi 5 is 2.4 tokens/s (Q8_0, llama.cpp (llama-bench, --mmap 0)), from 1 sourced test. Source: r/LocalLLaMA thread author (https://www.reddit.com/r/LocalLLaMA/comments/1sdcdno/benchmarks_of_gemma4_and_multiple_others_on/).
How fast does Qwen3.5 4B run on Raspberry Pi 4?
Best reported generation speed for Qwen3.5 4B on Raspberry Pi 4 is 1.1 tokens/s (Ollama (CPU only, qwen3.5:4b default tag)), from 1 sourced test. Source: Timothy Lewis (@tolewis on X) (https://x.com/tolewis/status/2112240842861641996).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 516 GB RAM | Qwen3.5 4B4B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.4prompt 31.0 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 4 | Qwen3.5 4B4B params | Ollama (CPU only, qwen3.5:4b default tag) | 1.1 | ₹18,497 Buy0.06 t/s per ₹1k | Community Timothy Lewis (@tolewis on X)2026-10-19 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).