Can a Jetson Orin Nano Super run Llama 3.2 1B?
Yes, usably. Best reported generation speed: 51.9 tokens/s on Jetson Orin Nano Super (Q4_K_M, llama.cpp b9292 (MAXN power mode)), per Yuvraj Singh (blog). Boards tested: Jetson Orin Nano Super.
Llama 3.2 1B speed by board
- Jetson Orin Nano Super: 51.9 tokens/s best (Q4_K_M, llama.cpp b9292 (MAXN power mode)), 2 tests
FAQ
Which edge board runs Llama 3.2 1B fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Llama 3.2 1B: 51.9 tokens/s generation (Q4_K_M, llama.cpp b9292 (MAXN power mode)).
How fast does Llama 3.2 1B run on Jetson Orin Nano Super?
Best reported generation speed for Llama 3.2 1B on Jetson Orin Nano Super is 51.9 tokens/s (Q4_K_M, llama.cpp b9292 (MAXN power mode)), from 2 sourced tests. Source: Yuvraj Singh (blog) (https://yuvrajsingh.io/posts/jetson-nano-super-benchmark-non-reasoning/).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 1B1.24B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 51.9 | ₹67,980 Buy0.76 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 1B1.24B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 49.9 | ₹67,980 Buy0.73 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).