Can a Jetson Orin Nano Super run Qwen2.5 0.5B?

Yes, usably. Best reported generation speed: 100.6 tokens/s on Jetson Orin Nano Super (Q4_K_M, llama.cpp b9292 (MAXN power mode)), per Yuvraj Singh (blog). Boards tested: Jetson Orin Nano Super.

Qwen2.5 0.5B speed by board

FAQ

Which edge board runs Qwen2.5 0.5B fastest?

Of the boards tested, Jetson Orin Nano Super is fastest for Qwen2.5 0.5B: 100.6 tokens/s generation (Q4_K_M, llama.cpp b9292 (MAXN power mode)).

How fast does Qwen2.5 0.5B run on Jetson Orin Nano Super?

Best reported generation speed for Qwen2.5 0.5B on Jetson Orin Nano Super is 100.6 tokens/s (Q4_K_M, llama.cpp b9292 (MAXN power mode)), from 2 sourced tests. Source: Yuvraj Singh (blog) (https://yuvrajsingh.io/posts/jetson-nano-super-benchmark-non-reasoning/).

Board ↕Model ↕Runtime & setup ↕Gen t/s ↕Price ₹ (India) ↕Source ↕
Jetson Orin Nano Super8 GB RAMQwen2.5 0.5B0.5B params · Q4_K_Mllama.cpp b9292 (MAXN power mode)Active fan100.6₹67,980 Buy1.48 t/s per ₹1kCommunity Yuvraj Singh (blog)2026-05-29
Jetson Orin Nano Super8 GB RAMQwen2.5 0.5B0.5B params · Q4_K_MOllama v0.24.0 (MAXN power mode)Active fan61.2₹67,980 Buy0.90 t/s per ₹1kCommunity Yuvraj Singh (blog)2026-05-29

Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).

📬 The EdgeLLM Weekly

Every week, free: new real-world benchmarks · India price drops on boards · one build idea you can try this weekend.

No spam. Unsubscribe anytime.