Can a Raspberry Pi 5 run gpt-oss 20B?
Yes, but slowly. Best reported generation speed: 4.8 tokens/s on Raspberry Pi 5 (IQ4_XS, llama.cpp (llama-bench, --mmap 0)), per r/LocalLLaMA thread author. Boards tested: Raspberry Pi 5.
gpt-oss 20B speed by board
- Raspberry Pi 5: 4.8 tokens/s best (IQ4_XS, llama.cpp (llama-bench, --mmap 0)), 2 tests
FAQ
Which edge board runs gpt-oss 20B fastest?
Of the boards tested, Raspberry Pi 5 is fastest for gpt-oss 20B: 4.8 tokens/s generation (IQ4_XS, llama.cpp (llama-bench, --mmap 0)).
How fast does gpt-oss 20B run on Raspberry Pi 5?
Best reported generation speed for gpt-oss 20B on Raspberry Pi 5 is 4.8 tokens/s (IQ4_XS, llama.cpp (llama-bench, --mmap 0)), from 2 sourced tests. Source: r/LocalLLaMA thread author (https://www.reddit.com/r/LocalLLaMA/comments/1sdcdno/benchmarks_of_gemma4_and_multiple_others_on/).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · IQ4_XS | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 4.8 ⚠ unusual, check sourceprompt 9.1 t/s | ₹34,191 Buy0.14 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
| Raspberry Pi 516 GB RAM | gpt-oss 20B20B params · Q8_0 | llama.cpp (llama-bench, --mmap 0)1TB NVMe SSD via official M.2 HAT+ (PCIe Gen3) | 2.7prompt 4.8 t/s | ₹34,191 Buy0.08 t/s per ₹1k | Community r/LocalLLaMA thread author2026-04 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).