Can a Jetson Orin Nano Super run Llama 3.1 8B?
Llama 3.1 8B speed by board
- Jetson Orin Nano Super: 19.1 tokens/s best (INT4, MLC (jetson-containers)), 1 test
- Jetson Orin Nano (original): 14.0 tokens/s best (INT4, MLC (jetson-containers)), 1 test
FAQ
Which edge board runs Llama 3.1 8B fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Llama 3.1 8B: 19.1 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 14.0 tokens/s.
How fast does Llama 3.1 8B run on Jetson Orin Nano Super?
Best reported generation speed for Llama 3.1 8B on Jetson Orin Nano Super is 19.1 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
How fast does Llama 3.1 8B run on Jetson Orin Nano (original)?
Best reported generation speed for Llama 3.1 8B on Jetson Orin Nano (original) is 14.0 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Llama 3.1 8B8B params · INT4 | MLC (jetson-containers) | 19.1 | ₹67,980 Buy0.28 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Llama 3.1 8B8B params · INT4 | MLC (jetson-containers) | 14.0 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).