Can a Jetson Orin Nano Super run Llama 3.2 3B?
Llama 3.2 3B speed by board
- Jetson Orin Nano Super: 43.1 tokens/s best (INT4, MLC (jetson-containers)), 1 test
- Jetson Orin Nano (original): 27.7 tokens/s best (INT4, MLC (jetson-containers)), 1 test
FAQ
Which edge board runs Llama 3.2 3B fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Llama 3.2 3B: 43.1 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 27.7 tokens/s.
How fast does Llama 3.2 3B run on Jetson Orin Nano Super?
Best reported generation speed for Llama 3.2 3B on Jetson Orin Nano Super is 43.1 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
How fast does Llama 3.2 3B run on Jetson Orin Nano (original)?
Best reported generation speed for Llama 3.2 3B on Jetson Orin Nano (original) is 27.7 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Llama 3.2 3B3.2B params · INT4 | MLC (jetson-containers) | 43.1 | ₹67,980 Buy0.63 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Llama 3.2 3B3.2B params · INT4 | MLC (jetson-containers) | 27.7 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).