Can a Jetson Orin Nano Super run Qwen2.5 7B?
Qwen2.5 7B speed by board
- Jetson Orin Nano Super: 21.8 tokens/s best (INT4, MLC (jetson-containers)), 1 test
- Jetson Orin Nano (original): 14.2 tokens/s best (INT4, MLC (jetson-containers)), 1 test
FAQ
Which edge board runs Qwen2.5 7B fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Qwen2.5 7B: 21.8 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 14.2 tokens/s.
How fast does Qwen2.5 7B run on Jetson Orin Nano Super?
Best reported generation speed for Qwen2.5 7B on Jetson Orin Nano Super is 21.8 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
How fast does Qwen2.5 7B run on Jetson Orin Nano (original)?
Best reported generation speed for Qwen2.5 7B on Jetson Orin Nano (original) is 14.2 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Qwen2.5 7B7B params · INT4 | MLC (jetson-containers) | 21.8 | ₹67,980 Buy0.32 t/s per ₹1k | Vendor NVIDIA Jetson AI Lab2024-2025 |
| Jetson Orin Nano (original)8 GB RAM | Qwen2.5 7B7B params · INT4 | MLC (jetson-containers) | 14.2 | Now sold as Jetson Orin Nano Super | Vendor NVIDIA Jetson AI Lab2024-2025 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).