Raspberry Pi CM4 vs Raspberry Pi 5 for LLMs
Different runtimes/quants across sources; medians are indicative.
| Raspberry Pi CM4 | Raspberry Pi 5 | |
|---|---|---|
| India price (cheapest seen) | ₹6,185 | ₹18,643 |
| Small 1–3B median gen t/s | 2.1 (3 tests) | 5.4 (19 tests) |
| Medium 7–8B median gen t/s | 0.8 (2 tests) | 1.9 (14 tests) |
| Big 14B+ median gen t/s | Not tested yet | 1.3 (17 tests) |
Which is faster for local LLMs: Raspberry Pi CM4 or Raspberry Pi 5?
For small 1-3B models, Raspberry Pi 5 is fastest in our sourced results (Raspberry Pi CM4 2.1 tokens/s median over 3 tests, Raspberry Pi 5 5.4 tokens/s median over 19 tests). For 7-8B models, Raspberry Pi 5 is fastest in our sourced results (Raspberry Pi CM4 0.8 tokens/s median over 2 tests, Raspberry Pi 5 1.9 tokens/s median over 14 tests).
Models tested on all
SPONSORED
Your board here
Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →
Affiliate disclosure: some Buy links may become affiliate links later (marked in code). We may earn a commission at no cost to you. Rankings and data are never paid for.