Open, sourced edge-AI benchmarks
Real LLM speeds on Raspberry Pi, Jetson & RK3588 boards
Sourced tokens/sec benchmarks plus India prices, so you can pick the right edge board before you buy.
111sourced results
10boards
70models
How it works
From raw benchmarks to the right board in 3 steps
Collect sourced results
Every tokens/sec figure comes from a public benchmark post and links back to it. We never guess missing details.
Match India prices
Each board is paired with the cheapest Indian retailer listing we have seen, with the date it was checked.
Pick with confidence
Compare medians by model size, use the picker for your budget, or dig into the full leaderboard.
Top boards
Fastest boards for small 1–3B models
Ranked by median generation speed across sourced small-model tests. Price is the cheapest India listing seen (not live); boards without an Indian listing show their best speed instead.
#1#2#3#4#5#6
Jetson Orin Nano Super
- Median speed
- 38.1 t/s
- India price
- ₹67,980
Jetson Orin Nano (original)
- Median speed
- 24.7 t/s
- Best speed
- 27.7 t/s
Radxa ROCK 5B+ (RK3588)
- Median speed
- 17.0 t/s
- Best speed
- 17.0 t/s
Turing Pi RK1 (RK3588)
- Median speed
- 14.0 t/s
- Best speed
- 14.0 t/s
Orange Pi 5 (RK3588S)
- Median speed
- 6.9 t/s
- India price
- ₹29,000
Orange Pi 5 Plus (RK3588)
- Median speed
- 6.2 t/s
- India price
- ₹84,864
🧭 Pick my board
Based only on real sourced tests in the table below; price = cheapest India listing seen (not live). Speeds vary with runtime, quant and cooling.
🆕 New this week
- 2026-10-16: Seed: Raspberry Pi 5 results (+52 results)
- 2026-10-16: New boards: Jetson, RK3588, Pi 4, CM4 (+57 results)
- 2026-10-19: New board: Jetson AGX Orin 64GB (+1 results)
- 2026-10-20: X feedback watch (+1 results)
🎯 Wanted tests
- Jetson AGX Orin 64GB × Small 1–3B
- Jetson AGX Orin 64GB × Medium 7–8B
- Jetson AGX Orin 64GB × Big 14B+
- Jetson Orin Nano (original) × Big 14B+
- Jetson Orin Nano Super × Big 14B+
- Orange Pi 5 (RK3588S) × Medium 7–8B
SPONSORED
Your board here
Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →
How fast do LLMs run on small boards?
111 real, sourced benchmark results across 10 boards and 70 models. Every number links to where it was published. Click headers to sort. Contributors · Guides
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | SmolLM2 135M0.135B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 159.5 | ₹67,980 Buy2.35 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | SmolLM2 135M0.135B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 132.2 | ₹67,980 Buy1.94 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | LFM2.5 350M0.35B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 112.9 | ₹67,980 Buy1.66 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Qwen2.5 0.5B0.5B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 100.6 | ₹67,980 Buy1.48 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | SmolLM2 360M0.36B params · Q8_0 | llama.cpp b9292 (MAXN power mode)Active fan | 89.6 | ₹67,980 Buy1.32 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | SmolLM2 360M0.36B params · Q8_0 | Ollama v0.24.0 (MAXN power mode)Active fan | 76.4 | ₹67,980 Buy1.12 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | SmolLM2INT4 | MLC (jetson-containers) | 64.5 | ₹67,980 Buy0.95 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano Super8 GB RAM | Qwen2.5 0.5B0.5B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 61.2 | ₹67,980 Buy0.90 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Orange Pi 5 (RK3588S) | Granite 4.0 350M0.35B params · Q4_0 | rk-llama.cpp fork (CPU) | 55.2prompt 340.4 t/s | ₹29,000 Buy1.90 t/s per ₹1k | Community milhcbt/rk-llama.cpp2026 |
| Jetson Orin Nano Super8 GB RAM | Qwen3 0.6B0.6B params · Q8_0 | llama.cpp b9292 (MAXN power mode)Active fan | 54.3 | ₹67,980 Buy0.80 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | LFM2.5 1.2B1.2B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 52.7 | ₹67,980 Buy0.78 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 1B1.24B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 51.9 | ₹67,980 Buy0.76 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Qwen3 0.6B0.6B params · Q8_0 | Ollama v0.24.0 (MAXN power mode)Active fan | 51.3 | ₹67,980 Buy0.75 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp CUDA fbd441c37 (MAXN)NVMe 938GB + eMMC | 51.1prompt 1506.0 t/s | ₹67,980 Buy0.75 t/s per ₹1k | Vendor PicoCluster Claw2026-04-02 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 1B1.24B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 49.9 | ₹67,980 Buy0.73 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Gemma 3 1B1B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 44.3 | ₹67,980 Buy0.65 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 3B3.2B params · INT4 | MLC (jetson-containers) | 43.1 | ₹67,980 Buy0.63 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Orange Pi 5 (RK3588S) | Granite 4.0 350M0.35B params · Q8_0 | rk-llama.cpp fork (CPU) | 40.6prompt 163.4 t/s | ₹29,000 Buy1.40 t/s per ₹1k | Community milhcbt/rk-llama.cpp2026 |
| Jetson Orin Nano Super8 GB RAM | Phi 3.5 3B3.8B params · INT4 | MLC (jetson-containers) | 38.1 | ₹67,980 Buy0.56 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano Super8 GB RAM | Gemma 3 1B1B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 35.8 | ₹67,980 Buy0.53 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Gemma 2 2B2B params · INT4 | MLC (jetson-containers) | 35.0 | ₹67,980 Buy0.51 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Raspberry Pi 52 GB RAM | Qwen2.5 0.5B Instruct0.63B params · Q4_0 | llama.cpp (CPU) | 33.8prompt 173.7 t/s | ₹7,287 Buy4.64 t/s per ₹1k | Community llama.cpp discussion #30069 author2026-10-06 |
| Jetson Orin Nano Super8 GB RAM | LFM2.5 350M0.35B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 29.8 | ₹67,980 Buy0.44 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Orange Pi 5 (RK3588S) | Granite 4.0 350M0.35B params · Q4_0 | rk-llama.cpp fork (NPU) | 26.7prompt 163.6 t/s | ₹29,000 Buy0.92 t/s per ₹1k | Community milhcbt/rk-llama.cpp2026 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 1.5B1.5B params · W8A8 | rknn-llm (NPU)NVMe data disk (/mnt/nvme) | 25.9 ⚠ unusual, check sourceprompt 493.0 t/s | ₹84,864 Buy0.30 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Orange Pi 5 (RK3588S) | Granite 4.0 350M0.35B params · Q8_0 | rk-llama.cpp fork (NPU) | 25.4prompt 311.8 t/s | ₹29,000 Buy0.88 t/s per ₹1k | Community milhcbt/rk-llama.cpp2026 |
| Jetson Orin Nano Super8 GB RAM | LFM2.5 1.2B1.2B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 23.0 | ₹67,980 Buy0.34 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Qwen3 4B Instruct 25074.02B params · Q4_0 | llama.cpp b6945 CUDA (-ngl 99 -fa 1 -t 6)M.2 NVMe Gen3x4 | 22.4prompt 710.3 t/s | ₹67,980 Buy0.33 t/s per ₹1k | Community r/LocalLLaMA user jwest332025 |
| Jetson Orin Nano Super8 GB RAM | Qwen2.5 7B7B params · INT4 | MLC (jetson-containers) | 21.8 | ₹67,980 Buy0.32 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.1 8B8B params · INT4 | MLC (jetson-containers) | 19.1 | ₹67,980 Buy0.28 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 3B IT3.21B params · Q4_K_M | llama.cpp CUDA fbd441c37 (MAXN)NVMe 938GB + eMMC | 18.4 ⚠ unusual, check sourceprompt 713.0 t/s | ₹67,980 Buy0.27 t/s per ₹1k | Vendor PicoCluster Claw2026-04-02 |
| Jetson Orin Nano Super8 GB RAM | Phi-3 3.8B3.8B params · Q4 | llama.cpp CUDA fbd441c37 (MAXN)NVMe 938GB + eMMC | 16.9 ⚠ unusual, check sourceprompt 537.0 t/s | ₹67,980 Buy0.25 t/s per ₹1k | Vendor PicoCluster Claw2026-04-02 |
| Raspberry Pi 5 | BitNet b1.58 2B2B params · 1.58-bit | Cougar (custom Rust runner)Stock cooler (throttled to 1.6 GHz) | 16.1 ⚠ unusual, check source | ₹18,643 Buy0.86 t/s per ₹1k | Community r/LocalLLaMA thread author (Cougar)2026-03-25 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · W8A8 | rknn-llm (NPU)NVMe data disk (/mnt/nvme) | 14.4prompt 284.0 t/s | ₹84,864 Buy0.17 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Raspberry Pi 516 GB RAM | Qwen3.5 0.8B0.8B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 11.5prompt 127.7 t/s | ₹34,191 Buy0.34 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 11.1 ⚠ unusual, check sourceprompt 61.8 t/s | ₹34,191 Buy0.32 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.2 1B IT1.24B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 10.8prompt 72.9 t/s | ₹34,191 Buy0.32 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 3 1B IT1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 10.4prompt 60.2 t/s | ₹34,191 Buy0.31 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp (GGUF) | 10.0 | ₹18,643 Buy0.54 t/s per ₹1k | Community r/LocalLLaMA thread author2024-01-11 |
| Raspberry Pi 516 GB RAM | OLMo 2 1B IT1.48B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 9.8prompt 68.5 t/s | ₹34,191 Buy0.29 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Jetson Orin Nano Super8 GB RAM | Gemma 2 9B9B params · INT4 | MLC (jetson-containers) | 9.2 ⚠ unusual, check source | ₹67,980 Buy0.14 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Raspberry Pi 516 GB RAM | Gemma 3 1B IT Heretic1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 9.0prompt 52.1 t/s | ₹34,191 Buy0.26 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | SmolLM2 1.7B IT1.71B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 7.2prompt 43.1 t/s | ₹34,191 Buy0.21 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Orange Pi 5 (RK3588S) | Phi-33.8B params · IQ4_XS | llama.cpp (-t 4, ~b2787) | 6.9prompt 10.8 t/s | ₹29,000 Buy0.24 t/s per ₹1k | Community llama.cpp issue #7176 author2024-05-09 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 1.5B1.5B params · Q8_0 | llama.cpp NPU forkNVMe data disk (/mnt/nvme) | 6.3prompt 408.0 t/s | ₹84,864 Buy0.07 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 1.5B1.5B params · Q8_0 | llama.cpp CPUNVMe data disk (/mnt/nvme) | 6.1prompt 92.0 t/s | ₹84,864 Buy0.07 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Raspberry Pi 516 GB RAM | Qwen3.5 2B2B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 5.6prompt 75.9 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT Heretic4.65B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 5.4prompt 37.8 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT4.65B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 5.4prompt 36.8 t/s | ₹34,191 Buy0.16 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | Phi-2 (dolphin-2.6)2.7B params · Q4_K_M | llama.cpp (GGUF) | 5.0 | ₹18,643 Buy0.27 t/s per ₹1k | Community r/LocalLLaMA thread author2024-01-11 |
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · IQ4_XS | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 4.8 ⚠ unusual, check sourceprompt 9.1 t/s | ₹34,191 Buy0.14 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · Q4_0 | llama.cpp CPUNVMe data disk (/mnt/nvme) | 4.7prompt 25.0 t/s | ₹84,864 Buy0.06 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Raspberry Pi 516 GB RAM | SmolLM3 3B3.08B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.5prompt 26.9 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E2B IT4.65B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 4.5prompt 41.8 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Llama 3.2 3B IT3.21B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.4prompt 26.7 t/s | ₹34,191 Buy0.13 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 3B IT3.43B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 4.2prompt 24.2 t/s | ₹34,191 Buy0.12 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Orange Pi 5 Plus (RK3588)16 GB RAM | Qwen2.5 3B3B params · Q4_0 | llama.cpp NPU forkNVMe data disk (/mnt/nvme) | 4.2prompt 230.0 t/s | ₹84,864 Buy0.05 t/s per ₹1k | Community jishuzhan.net author2026-09-14 |
| Raspberry Pi 516 GB RAM | Phi-4 Mini Reasoning3.84B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 3.4prompt 20.3 t/s | ₹34,191 Buy0.10 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Phi-4 Mini Instruct3.84B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.9prompt 17.7 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT Heretic7.52B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.8prompt 17.8 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Bonsai 8B8B params · Q1_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.8prompt 3.3 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.7prompt 4.8 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.7prompt 17.9 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Gemma 4 26B-A4B IT25.23B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.5prompt 9.2 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 4B4B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.4prompt 31.0 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.3prompt 22.2 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3-Coder 30B-A3B30B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.3prompt 10.8 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 35B-A3B35B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.2prompt 10.6 t/s | ₹34,191 Buy0.07 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT Heretic8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.1prompt 9.2 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 2.0prompt 9.1 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | gpt-oss 120B120B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.9prompt 5.1 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Ministral 3 8B IT8.49B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.9prompt 5.8 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.9prompt 6.3 t/s | ₹34,191 Buy0.06 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Hermes 3 8B8.03B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.8prompt 8.1 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 8B IT8.49B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.7prompt 8.1 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | Dolphin 2.6 Mistral 7B DPO laser7B params · Q5_K_M | llama.cpp (GGUF) | 1.6 | ₹18,643 Buy0.09 t/s per ₹1k | Community r/LocalLLaMA commenter2024-01-11 |
| Raspberry Pi 516 GB RAM | GLM-4.7-Flash 30B-A3B30B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.6prompt 6.6 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 4 E4B IT7.52B params · Q8_0 | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.6prompt 8.7 t/s | ₹34,191 Buy0.05 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Mistral 3 14B14B params · Q4_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.5prompt 5.8 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 9B9B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.4prompt 18.2 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Phi-4 Reasoning Plus14.66B params · UD-Q2_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.3prompt 2.8 t/s | ₹34,191 Buy0.04 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 14B IT13.51B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.2prompt 5.2 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Ministral 3 14B IT13.51B params · UD-Q3_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.2prompt 3.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Llama 3.1 8B IT8.03B params · Q8_0 | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.1prompt 4.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Phi-4 Reasoning Plus14.66B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 1.1prompt 4.2 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Qwen3.5 122B-A10B122B params · Q2_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.1prompt 2.5 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Gemma 3 12B IT12B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 1.0 ⚠ unusual, check sourceprompt 12.9 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | Qwen3.5 27B27B params · Q2_K_M | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 0.9prompt 1.4 t/s | ₹34,191 Buy0.03 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi CM4 | Llama 3 8B Instruct8B params · Q2_K | Ollama | 0.9prompt 1.0 t/s | ₹6,185 Buy0.14 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
| Raspberry Pi 516 GB RAM | Magistral Small24B params · UD-Q2_K_XL | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 0.8prompt 1.6 t/s | ₹34,191 Buy0.02 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 516 GB RAM | Qwen3.5 122B-A10B122B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 0.4 ⚠ unusual, check sourceprompt 2.6 t/s | ₹34,191 Buy0.01 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Jetson Orin Nano (original)8 GB RAM | SmolLM2INT4 | MLC (jetson-containers) | 41.0 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Llama 3.2 3B3.2B params · INT4 | MLC (jetson-containers) | 27.7 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson AGX Orin 64GB64 GB RAM | Qwen3.8-Flash-Next Gyro-MTQ2_0 (2-bit trellis experts) | Strata Orin fork bb98d09 (CUDA SM87, MTP speculative decoding, MAXN)NVMe | 25.8prompt 555.0 t/s | No India listing yet | Community kim-haneol (Strata-Orin)2026-10-08 |
| Jetson Orin Nano (original)8 GB RAM | Phi 3.5 3B3.8B params · INT4 | MLC (jetson-containers) | 24.7 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Gemma 2 2B2B params · INT4 | MLC (jetson-containers) | 21.5 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Radxa ROCK 5B+ (RK3588)16 GB RAM | Gemma 3 1B IT1B params · Q8_0 | rk-llama.cpp fork (NPU) | 17.0prompt 201.6 t/s | No India listing yet | Community Mojo24x7/rk-llama.cpp2026 |
| Jetson Orin Nano (original)8 GB RAM | Qwen2.5 7B7B params · INT4 | MLC (jetson-containers) | 14.2 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Llama 3.1 8B8B params · INT4 | MLC (jetson-containers) | 14.0 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Turing Pi RK1 (RK3588)32 GB RAM | LFM2.5 2.6B2.6B params · Q4_K_M | llama.cpp CPU (4 threads) | 14.0prompt 30.0 t/s | No India listing yet | Vendor Turing Pi blog2026-08-04 |
| Radxa ROCK 5B+ (RK3588)16 GB RAM | Qwen3 30B-A3B30B params · Q4_0 | rk-llama.cpp fork (NPU) | 9.6prompt 21.1 t/s | No India listing yet | Community Mojo24x7/rk-llama.cpp2026 |
| Jetson Orin Nano (original)8 GB RAM | Gemma 2 9B9B params · INT4 | MLC (jetson-containers) | 7.2 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Raspberry Pi CM4 | TinyLlama 1.1B Chat1.1B params | Ollama | 5.1 ⚠ unusual, check sourceprompt 7.3 t/s | ₹6,185 Buy0.82 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
| Radxa ROCK 5B+ (RK3588)16 GB RAM | Qwen3.6 35B-A3B35B params · Q4_0 | rk-llama.cpp fork (NPU) | 4.1prompt 18.5 t/s | No India listing yet | Community Mojo24x7/rk-llama.cpp2026 |
| Radxa ROCK 5B+ (RK3588)16 GB RAM | Gemma 4 E4B ITQ8_0 | rk-llama.cpp fork (NPU) | 4.0prompt 38.2 t/s | No India listing yet | Community Mojo24x7/rk-llama.cpp2026 |
| Raspberry Pi CM4 | Gemma 2B Instruct2B params | Ollama | 2.1prompt 3.5 t/s | ₹6,185 Buy0.34 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | Ollama | 1.6 | ₹18,497 Buy0.09 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
| Raspberry Pi CM4 | Phi-33.8B params | Ollama | 1.4prompt 2.0 t/s | ₹6,185 Buy0.22 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
| Raspberry Pi 4 | Qwen3.5 4B4B params | Ollama (CPU only, qwen3.5:4b default tag) | 1.1 | ₹18,497 Buy0.06 t/s per ₹1k | Community Timothy Lewis (@tolewis on X)2026-10-19 |
| Raspberry Pi 48 GB RAM | Gemma-derived ~1B1B params | llama.cpp (Docker) | 1.0 | ₹18,497 Buy0.06 t/s per ₹1k | Community Thomas Nahon (Medium)2025-04-27 |
| Raspberry Pi CM4 | Llama 3 8B8B params | Ollama | 0.8prompt 1.0 t/s | ₹6,185 Buy0.13 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).