Can a Jetson Orin Nano Super run Qwen3 4B Instruct 2507?
Qwen3 4B Instruct 2507 speed by board
- Jetson Orin Nano Super: 22.4 tokens/s best (Q4_0, llama.cpp b6945 CUDA (-ngl 99 -fa 1 -t 6)), 1 test
FAQ
Which edge board runs Qwen3 4B Instruct 2507 fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for Qwen3 4B Instruct 2507: 22.4 tokens/s generation (Q4_0, llama.cpp b6945 CUDA (-ngl 99 -fa 1 -t 6)).
How fast does Qwen3 4B Instruct 2507 run on Jetson Orin Nano Super?
Best reported generation speed for Qwen3 4B Instruct 2507 on Jetson Orin Nano Super is 22.4 tokens/s (Q4_0, llama.cpp b6945 CUDA (-ngl 99 -fa 1 -t 6)), from 1 sourced test. Source: r/LocalLLaMA user jwest33 (https://www.reddit.com/r/LocalLLaMA/comments/1oo88sq/nvidia_jetson_orin_nano_super_8_gb_llamabench/).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | Qwen3 4B Instruct 25074.02B params · Q4_0 | llama.cpp b6945 CUDA (-ngl 99 -fa 1 -t 6)M.2 NVMe Gen3x4 | 22.4prompt 710.3 t/s | ₹67,980 Buy0.33 t/s per ₹1k | Community r/LocalLLaMA user jwest332025 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).