Can a Jetson Orin Nano Super run Gemma 2 2B?

Yes, usably. Best reported generation speed: 35.0 tokens/s on Jetson Orin Nano Super (INT4, MLC (jetson-containers)), per NVIDIA Jetson AI Lab. Boards tested: Jetson Orin Nano (original), Jetson Orin Nano Super.

Gemma 2 2B speed by board

FAQ

Which edge board runs Gemma 2 2B fastest?

Of the boards tested, Jetson Orin Nano Super is fastest for Gemma 2 2B: 35.0 tokens/s generation (INT4, MLC (jetson-containers)). Next is Jetson Orin Nano (original) at 21.5 tokens/s.

How fast does Gemma 2 2B run on Jetson Orin Nano Super?

Best reported generation speed for Gemma 2 2B on Jetson Orin Nano Super is 35.0 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).

How fast does Gemma 2 2B run on Jetson Orin Nano (original)?

Best reported generation speed for Gemma 2 2B on Jetson Orin Nano (original) is 21.5 tokens/s (INT4, MLC (jetson-containers)), from 1 sourced test. Source: NVIDIA Jetson AI Lab (https://www.jetson-ai-lab.com/archive/benchmarks.html).

Board ↕Model ↕Runtime & setup ↕Gen t/s ↕Price ₹ (India) ↕Source ↕
Jetson Orin Nano Super8 GB RAMGemma 2 2B2B params · INT4MLC (jetson-containers)35.0₹67,980 Buy0.51 t/s per ₹1kVendor NVIDIA Jetson AI Lab2024-2025
Jetson Orin Nano (original)8 GB RAMGemma 2 2B2B params · INT4MLC (jetson-containers)21.5Now sold as Jetson Orin Nano SuperVendor NVIDIA Jetson AI Lab2024-2025

Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).

📬 The EdgeLLM Weekly

Every week, free: new real-world benchmarks · India price drops on boards · one build idea you can try this weekend.

No spam. Unsubscribe anytime.