Raspberry Pi 5 vs Radxa ROCK 5B+ (RK3588) for LLMs

Different runtimes/quants across sources; medians are indicative.

Raspberry Pi 5Radxa ROCK 5B+ (RK3588)
India price (cheapest seen)₹18,643No India listing yet
Small 1–3B median gen t/s5.4 (19 tests)17.0 (1 tests)
Medium 7–8B median gen t/s1.9 (14 tests)Not tested yet
Big 14B+ median gen t/s1.3 (17 tests)6.8 (2 tests)

Which is faster for local LLMs: Raspberry Pi 5 or Radxa ROCK 5B+ (RK3588)?

For small 1-3B models, Radxa ROCK 5B+ (RK3588) is fastest in our sourced results (Raspberry Pi 5 5.4 tokens/s median over 19 tests, Radxa ROCK 5B+ (RK3588) 17.0 tokens/s result). For 14B+ models, Radxa ROCK 5B+ (RK3588) is fastest in our sourced results (Raspberry Pi 5 1.3 tokens/s median over 17 tests, Radxa ROCK 5B+ (RK3588) 6.8 tokens/s median over 2 tests).

Models tested on all

SPONSORED

Your board here

Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →

Affiliate disclosure: some Buy links may become affiliate links later (marked in code). We may earn a commission at no cost to you. Rankings and data are never paid for.

📬 The EdgeLLM Weekly

Every week, free: new real-world benchmarks · India price drops on boards · one build idea you can try this weekend.

No spam. Unsubscribe anytime.