Jetson Orin Nano (original) vs Jetson Orin Nano Super for LLMs

Different runtimes/quants across sources; medians are indicative.

Jetson Orin Nano (original)Jetson Orin Nano Super
India price (cheapest seen)No India listing yet₹67,980
Small 1–3B median gen t/s24.7 (3 tests)38.1 (13 tests)
Medium 7–8B median gen t/s14.0 (3 tests)19.1 (3 tests)
Big 14B+ median gen t/sNot tested yetNot tested yet

Which is faster for local LLMs: Jetson Orin Nano (original) or Jetson Orin Nano Super?

For small 1-3B models, Jetson Orin Nano Super is fastest in our sourced results (Jetson Orin Nano (original) 24.7 tokens/s median over 3 tests, Jetson Orin Nano Super 38.1 tokens/s median over 13 tests). For 7-8B models, Jetson Orin Nano Super is fastest in our sourced results (Jetson Orin Nano (original) 14.0 tokens/s median over 3 tests, Jetson Orin Nano Super 19.1 tokens/s median over 3 tests).

Models tested on all

SPONSORED

Your board here

Reach makers and engineers choosing edge-AI hardware. Sponsor this slot →

Affiliate disclosure: some Buy links may become affiliate links later (marked in code). We may earn a commission at no cost to you. Rankings and data are never paid for.

📬 The EdgeLLM Weekly

Every week, free: new real-world benchmarks · India price drops on boards · one build idea you can try this weekend.

No spam. Unsubscribe anytime.