Can a Radxa ROCK 5B+ (RK3588) run Gemma 4 E4B IT?
Gemma 4 E4B IT speed by board
- Radxa ROCK 5B+ (RK3588): 4.0 tokens/s best (Q8_0, rk-llama.cpp fork (NPU)), 1 test
- Raspberry Pi 5: 2.7 tokens/s best (Q4_K_M, llama.cpp b9307 (CPU, OpenBLAS)), 3 tests
FAQ
Which edge board runs Gemma 4 E4B IT fastest?
Of the boards tested, Radxa ROCK 5B+ (RK3588) is fastest for Gemma 4 E4B IT: 4.0 tokens/s generation (Q8_0, rk-llama.cpp fork (NPU)). Next is Raspberry Pi 5 at 2.7 tokens/s.
How fast does Gemma 4 E4B IT run on Radxa ROCK 5B+ (RK3588)?
Best reported generation speed for Gemma 4 E4B IT on Radxa ROCK 5B+ (RK3588) is 4.0 tokens/s (Q8_0, rk-llama.cpp fork (NPU)), from 1 sourced test. Source: Mojo24x7/rk-llama.cpp (https://github.com/Mojo24x7/rk-llama.cpp).
How fast does Gemma 4 E4B IT run on Raspberry Pi 5?
Best reported generation speed for Gemma 4 E4B IT on Raspberry Pi 5 is 2.7 tokens/s (Q4_K_M, llama.cpp b9307 (CPU, OpenBLAS)), from 3 sourced tests. Source: davidscarth (edge-ai-study) (https://github.com/davidscarth/edge-ai-study/blob/main/RASPI5.md).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.7prompt 17.9 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.3prompt 22.2 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.6prompt 8.7 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Radxa ROCK 5B+ (RK3588)16 GB RAM | Gemma 4 E4B ITQ8_0 | rk-llama.cpp fork (NPU) | 4.0prompt 38.2 t/s | No India listing yet | Community Mojo24x7/rk-llama.cpp2026 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).