Raspberry Pi 5 vs Jetson Orin Nano Super vs Orange Pi 5 (RK3588S) for LLMs
Different runtimes/quants across sources; medians are indicative.
| Raspberry Pi 5 | Jetson Orin Nano Super | Orange Pi 5 (RK3588S) | |
|---|---|---|---|
| India price (cheapest seen) | ₹18,643 | ₹67,980 | ₹29,000 |
| Small 1–3B median gen t/s | 5.4 (19 tests) | 38.1 (13 tests) | 6.9 (1 tests) |
| Medium 7–8B median gen t/s | 1.9 (14 tests) | 19.1 (3 tests) | Not tested yet |
| Big 14B+ median gen t/s | 1.3 (17 tests) | Not tested yet | Not tested yet |
Models tested on all
- No model tested on all of these yet: help fill the gap.
SPONSORED
Your board here
Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →
Affiliate disclosure: some Buy links may become affiliate links later (marked in code). We may earn a commission at no cost to you. Rankings and data are never paid for.