Can a Jetson Orin Nano Super run TinyLlama 1.1B Chat?
TinyLlama 1.1B Chat speed by board
- Jetson Orin Nano Super: 51.1 tokens/s best (Q4_K_M, llama.cpp CUDA fbd441c37 (MAXN)), 1 test
- Raspberry Pi 5: 11.1 tokens/s best (Q4_K_M, llama.cpp b9307 (CPU, OpenBLAS)), 2 tests
- Raspberry Pi CM4: 5.1 tokens/s best (Ollama), 1 test
FAQ
Which edge board runs TinyLlama 1.1B Chat fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for TinyLlama 1.1B Chat: 51.1 tokens/s generation (Q4_K_M, llama.cpp CUDA fbd441c37 (MAXN)). Next is Raspberry Pi 5 at 11.1 tokens/s.
How fast does TinyLlama 1.1B Chat run on Jetson Orin Nano Super?
Best reported generation speed for TinyLlama 1.1B Chat on Jetson Orin Nano Super is 51.1 tokens/s (Q4_K_M, llama.cpp CUDA fbd441c37 (MAXN)), from 1 sourced test. Source: PicoCluster Claw (https://picocluster-claw.com/reference/benchmarks/).
How fast does TinyLlama 1.1B Chat run on Raspberry Pi 5?
Best reported generation speed for TinyLlama 1.1B Chat on Raspberry Pi 5 is 11.1 tokens/s (Q4_K_M, llama.cpp b9307 (CPU, OpenBLAS)), from 2 sourced tests. Source: davidscarth (edge-ai-study) (https://github.com/davidscarth/edge-ai-study/blob/main/RASPI5.md).
How fast does TinyLlama 1.1B Chat run on Raspberry Pi CM4?
Best reported generation speed for TinyLlama 1.1B Chat on Raspberry Pi CM4 is 5.1 tokens/s (Ollama), from 1 sourced test. Source: hammad93 (GitHub gist) (https://gist.github.com/hammad93/eab28862024e480a2046d51bc39bd462/7e502ea4019400a75f4fc5c369992b273f2a5398).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp CUDA fbd441c37 (MAXN)NVMe 938GB + eMMC | 51.1prompt 1506.0 t/s | ₹67,980 Buy0.75 t/s per ₹1k | Vendor PicoCluster Claw2026-04-02 |
| Raspberry Pi 516 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp b9307 (CPU, OpenBLAS)NVMe (official 512GB SSD kit) · Active Cooler | 11.1 ⚠ unusual, check sourceprompt 61.8 t/s | ₹34,191 Buy0.32 t/s per ₹1k | Community davidscarth (edge-ai-study)2026-05-27 |
| Raspberry Pi 58 GB RAM | TinyLlama 1.1B Chat1.1B params · Q4_K_M | llama.cpp (GGUF) | 10.0 | ₹18,643 Buy0.54 t/s per ₹1k | Community r/LocalLLaMA thread author2024-01-11 |
| Raspberry Pi CM4 | TinyLlama 1.1B Chat1.1B params | Ollama | 5.1 ⚠ unusual, check sourceprompt 7.3 t/s | ₹6,185 Buy0.82 t/s per ₹1k | Community hammad93 (GitHub gist)2024-05-04 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).