LLMs on the Raspberry Pi 4
3 sourced results. 0 configurations reached 5+ tokens/s generation.
Good for
- Small 1–3B (chat, simple agents): too slow to chat, median 1.1 t/s (≈1 words/s), best 1.6 t/s, 3 tests
- Not tested yet: Medium 7–8B, Big 14B+. Help fill the gap
Cheapest India price seen: ₹18,497 (Robu.in, in stock, checked 2026-10-16). Labels: ≥15 t/s fast · 5–15 usable · 2–5 slow · <2 too slow to chat. 1 token ≈ 0.75 words.
Real-world uses
Our data for this board: small (1–3B) models: median 1.1 t/s across 3 tests (too slow to chat). Use cases that need chat-speed replies want ≥5 t/s; background jobs can live with 2 t/s.
- Tiny command parser: Very small models for intents like 'turn on the fan'.
- Learning on hardware you already own: Expect slow speeds; good for experiments, not chat.
Your board here
Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →
India price comparison
Prices as seen on retailer pages (via search snapshots) on the date shown. Not live; confirm on the retailer page. Buy links are plain links for now: affiliate tags will be added later where marked.
| Retailer | Variant | Price | Stock | Checked | |
|---|---|---|---|---|---|
| FactoryForwardFar below other 8GB listings (Robu category page also shows ₹7,199): verify before trusting | 8GB | ₹7,199 | Check retailer | 2026-10-17 | Buy |
| RobocrazeProduct page shows sold out (2026-10-19) | 8GB | ₹18,495 | Out of stock / pre-order | 2026-10-19 | Buy |
| Robu.in | 8GB | ₹18,497 | In stock | 2026-10-16 | Buy |
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | Ollama | 1.6 | ₹18,497 Buy0.09 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
| Raspberry Pi 4 | Qwen3.5 4B4B params | Ollama (CPU only, qwen3.5:4b default tag) | 1.1 | ₹18,497 Buy0.06 t/s per ₹1k | Community Timothy Lewis (@tolewis on X)2026-10-19 |
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | llama.cpp (Docker) | 1.0 | ₹18,497 Buy0.06 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).