Can a Jetson Orin Nano Super run Phi 3.5 3B?
Phi 3.5 3B speed by board
- Jetson Orin Nano Super: 38.1 tokens/s best (INT4, MLC (jetson-containers)), 1 test
- Jetson Orin Nano (original): 24.7 tokens/s best (INT4, MLC (jetson-containers)), 1 test
FAQ
Which edge board runs Phi 3.5 3B fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Phi 3.5 3B: 38.1 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 24.7 tokens/s.
How fast does Phi 3.5 3B run on Jetson Orin Nano Super?
Best reported generation speed for Phi 3.5 3B on Jetson Orin Nano Super is 38.1 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
How fast does Phi 3.5 3B run on Jetson Orin Nano (original)?
Best reported generation speed for Phi 3.5 3B on Jetson Orin Nano (original) is 24.7 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Phi 3.5 3B3.8B params · INT4 | MLC (jetson-containers) | 38.1 | ₹67,980 Buy0.56 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Phi 3.5 3B3.8B params · INT4 | MLC (jetson-containers) | 24.7 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).