LLMs on the Raspberry Pi 5
52 sourced results. 14 configurations reached 5+ tokens/s generation.
Good for
- Small 1–3B (chat, simple agents): usable, median 5.4 t/s (≈4 words/s), best 16.1 t/s, 19 tests
- Medium 7–8B: too slow to chat, median 1.9 t/s (≈1 words/s), best 2.8 t/s, 14 tests
- Big 14B+: too slow to chat, median 1.3 t/s (≈1 words/s), best 4.8 t/s, 17 tests
Cheapest India price seen: ₹18,643 (Tech Depot, in stock, checked 2026-10-17). Labels: ≥15 t/s fast · 5–15 usable · 2–5 slow · <2 too slow to chat. 1 token ≈ 0.75 words.
Real-world uses
Our data for this board: small (1–3B) models: median 5.4 t/s across 19 tests (usable); medium (7–8B) models: median 1.9 t/s across 14 tests (too slow to chat); big (14B+) models: median 1.3 t/s across 17 tests (too slow to chat). Use cases that need chat-speed replies want ≥5 t/s; background jobs can live with 2 t/s.
- Learning local LLMs: Cheapest way to try llama.cpp/Ollama and learn quantization trade-offs.
- Home automation agent: Small model + GPIO/Home Assistant to turn sentences into actions.
- Offline chatbot for a classroom or shop: Small 1–3B models for FAQs without internet.
- Background summariser: Hourly log/news/email summaries where slow speed is fine.
SPONSORED
Your board here
Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →
India price comparison
Prices as seen on retailer pages (via search snapshots) on the date shown. Not live; confirm on the retailer page. Buy links are plain links for now: affiliate tags will be added later where marked.
| Retailer | Variant | Price | Stock | Checked | |
|---|---|---|---|---|---|
| Robu.inLink is a Robu search (exact product URL not confirmed). | 2GB | ₹7,287 | Check retailer | 2026-10-16 | Buy |
| Robu.inLink is a Robu search (exact product URL not confirmed). | 4GB | ₹12,331 | Check retailer | 2026-10-16 | Buy |
| Tech DepotPage says in stock; confirm on WhatsApp | 8GB | ₹18,643 | In stock | 2026-10-17 | Buy |
| Robu.in | 8GB | ₹19,618 | Check retailer | 2026-10-16 | Buy |
| RobocrazeProduct page shows sold out (2026-10-19) | 8GB | ₹19,999 | Out of stock / pre-order | 2026-10-19 | Buy |
| Robu.inLink is a Robu search (exact product URL not confirmed). | 16GB | ₹34,191 | Check retailer | 2026-10-16 | Buy |
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 52 GB RAM | Qwen2.5 0.5B Instruct0.63B params · Q4_0 | llama.cpp (CPU) | 33.8prompt 173.7 t/s | ₹7,287 Buy4.64 t/s per ₹1k | Community llama.cpp discussion #30069 author2026-10-06 |
| Raspberry Pi 5 | BitNet b1.58 2B2B params · 1.58-bit | Cougar (custom Rust runner)Stock cooler (throttled to 1.6 GHz) | 16.1 ⚠ unusual, check source | ₹18,643 Buy0.86 t/s per ₹1k | Community r/LocalLLaMA thread author (Cougar)2026-03-25 |
| Raspberry Pi 516 GB RAM | Qwen3.5 0.8B0.8B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 11.5prompt 127.7 t/s | ₹34,191 Buy0.34 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 11.1 ⚠ unusual, check sourceprompt 61.8 t/s | ₹34,191 Buy0.32 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.2 1B IT1.24B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 10.8prompt 72.9 t/s | ₹34,191 Buy0.32 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 3 1B IT1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 10.4prompt 60.2 t/s | ₹34,191 Buy0.31 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp (GGUF) | 10.0 | ₹18,643 Buy0.54 t/s per ₹1k | Community r/LocalLLaMA thread author2024-01-11 |
| Raspberry Pi 516 GB RAM | OLMo 2 1B IT1.48B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 9.8prompt 68.5 t/s | ₹34,191 Buy0.29 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 3 1B IT Heretic1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 9.0prompt 52.1 t/s | ₹34,191 Buy0.26 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | SmolLM2 1.7B IT1.71B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 7.2prompt 43.1 t/s | ₹34,191 Buy0.21 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Qwen3.5 2B2B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 5.6prompt 75.9 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT Heretic4.65B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 5.4prompt 37.8 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT4.65B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 5.4prompt 36.8 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | Phi-2 (dolphin-2.6)2.7B params · Q4_K_M | llama.cpp (GGUF) | 5.0 | ₹18,643 Buy0.27 t/s per ₹1k | Community r/LocalLLaMA thread author2024-01-11 |
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · IQ4_XS | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 4.8 ⚠ unusual, check sourceprompt 9.1 t/s | ₹34,191 Buy0.14 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | SmolLM3 3B3.08B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.5prompt 26.9 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT4.65B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 4.5prompt 41.8 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Llama 3.2 3B IT3.21B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.4prompt 26.7 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 3B IT3.43B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.2prompt 24.2 t/s | ₹34,191 Buy0.12 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Phi-4 Mini Reasoning3.84B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 3.4prompt 20.3 t/s | ₹34,191 Buy0.10 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Phi-4 Mini Instruct3.84B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.9prompt 17.7 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT Heretic7.52B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.8prompt 17.8 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Bonsai 8B8B params · Q1_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.8prompt 3.3 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.7prompt 4.8 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.7prompt 17.9 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 26B-A4B IT25.23B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.5prompt 9.2 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 4B4B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.4prompt 31.0 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.3prompt 22.2 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3-Coder 30B-A3B30B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.3prompt 10.8 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 35B-A3B35B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.2prompt 10.6 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT Heretic8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.1prompt 9.2 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.0prompt 9.1 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | gpt-oss 120B120B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.9prompt 5.1 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Ministral 3 8B IT8.49B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.9prompt 5.8 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.9prompt 6.3 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Hermes 3 8B8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.8prompt 8.1 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 8B IT8.49B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.7prompt 8.1 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | Dolphin 2.6 Mistral 7B DPO laser7B params · Q5_K_M | llama.cpp (GGUF) | 1.6 | ₹18,643 Buy0.09 t/s per ₹1k | Community r/LocalLLaMA commenter2024-01-11 |
| Raspberry Pi 516 GB RAM | GLM-4.7-Flash 30B-A3B30B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.6prompt 6.6 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.6prompt 8.7 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Mistral 3 14B14B params · Q4_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.5prompt 5.8 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 9B9B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.4prompt 18.2 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Phi-4 Reasoning Plus14.66B params · UD-Q2_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.3prompt 2.8 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 14B IT13.51B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.2prompt 5.2 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 14B IT13.51B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.2prompt 3.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · Q8_0 | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.1prompt 4.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Phi-4 Reasoning Plus14.66B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.1prompt 4.2 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Qwen3.5 122B-A10B122B params · Q2_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.1prompt 2.5 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 3 12B IT12B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.0 ⚠ unusual, check sourceprompt 12.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 27B27B params · Q2_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 0.9prompt 1.4 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Magistral Small24B params · UD-Q2_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 0.8prompt 1.6 t/s | ₹34,191 Buy0.02 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Qwen3.5 122B-A10B122B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 0.4 ⚠ unusual, check sourceprompt 2.6 t/s | ₹34,191 Buy0.01 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).