Can a Jetson Orin Nano Super run SmolLM2?

Yes, usably. Best reported generation speed: 64.5 tokens/s on Jetson Orin Nano Super (INT4, MLC (jetson-containers)), per NVIDIA Jetson AI Lab. Boards tested: Jetson Orin Nano (original), Jetson Orin Nano Super.

SmolLM2 speed by board

FAQ

Which edge board runs SmolLM2 fastest?

Of the boards tested, Jetson Orin Nano Super is fastest for SmolLM2: 64.5 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 41.0 tokens/s.

How fast does SmolLM2 run on Jetson Orin Nano Super?

Best reported generation speed for SmolLM2 on Jetson Orin Nano Super is 64.5 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).

How fast does SmolLM2 run on Jetson Orin Nano (original)?

Best reported generation speed for SmolLM2 on Jetson Orin Nano (original) is 41.0 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).

Board ↕Model ↕Runtime & setup ↕Gen t/s ↕Price ₹ (India) ↕Source ↕
Jetson Orin Nano Super8 GB RAMSmolLM2INT4MLC (jetson-containers)64.5₹67,980 Buy0.95 t/s per ₹1kVendor NVIDIA Jetson AI Lab2024-2025
Jetson Orin Nano (original)8 GB RAMSmolLM2INT4MLC (jetson-containers)41.0Now sold as Jetson Orin Nano SuperVendor NVIDIA Jetson AI Lab2024-2025

Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).

📬 The EdgeLLM Weekly

Every week, free: new real-world benchmarks · India price drops on boards · one build idea you can try this weekend.

No spam. Unsubscribe anytime.