Can a Raspberry Pi 4 run Gemma-derived ~1B?
Yes, but slowly. Best reported generation speed: 1.6 tokens/s on Raspberry Pi 4 (Ollama), per Thomas Nahon (Medium). Boards tested: Raspberry Pi 4.
Gemma-derived ~1B speed by board
- Raspberry Pi 4: 1.6 tokens/s best (Ollama), 2 tests
FAQ
Which edge board runs Gemma-derived ~1B fastest?
Of the boards tested, Raspberry Pi 4 is fastest for Gemma-derived ~1B: 1.6 tokens/s generation (Ollama).
How fast does Gemma-derived ~1B run on Raspberry Pi 4?
Best reported generation speed for Gemma-derived ~1B on Raspberry Pi 4 is 1.6 tokens/s (Ollama), from 2 sourced tests. Source: Thomas Nahon (Medium) (https://medium.com/@thomasnahon/llms-on-a-budget-testing-serving-frameworks-on-the-raspberry-pi-4-5fc56623840e).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | Ollama | 1.6 | ₹18,497 Buy0.09 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | llama.cpp (Docker) | 1.0 | ₹18,497 Buy0.06 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).