Can a Jetson Orin Nano Super run SmolLM2 135M?
Yes, usably. Best reported generation speed: 159.5 tokens/s on Jetson Orin Nano Super (Q4_K_M, llama.cpp b9292 (MAXN power mode)), per Yuvraj Singh (blog). Boards tested: Jetson Orin Nano Super.
SmolLM2 135M speed by board
- Jetson Orin Nano Super: 159.5 tokens/s best (Q4_K_M, llama.cpp b9292 (MAXN power mode)), 2 tests
FAQ
Which edge board runs SmolLM2 135M fastest?
Of the boards tested, Jetson Orin Nano Super is fastest for SmolLM2 135M: 159.5 tokens/s generation (Q4_K_M, llama.cpp b9292 (MAXN power mode)).
How fast does SmolLM2 135M run on Jetson Orin Nano Super?
Best reported generation speed for SmolLM2 135M on Jetson Orin Nano Super is 159.5 tokens/s (Q4_K_M, llama.cpp b9292 (MAXN power mode)), from 2 sourced tests. Source: Yuvraj Singh (blog) (https://yuvrajsingh.io/posts/jetson-nano-super-benchmark-non-reasoning/).
| Board ↕ | Model ↕ | Runtime & setup ↕ | Gen t/s ↕ | Price ₹ (India) ↕ | Source ↕ |
|---|---|---|---|---|---|
| Jetson Orin Nano Super8 GB RAM | SmolLM2 135M0.135B params · Q4_K_M | llama.cpp b9292 (MAXN power mode)Active fan | 159.5 | ₹67,980 Buy2.35 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
| Jetson Orin Nano Super8 GB RAM | SmolLM2 135M0.135B params · Q4_K_M | Ollama v0.24.0 (MAXN power mode)Active fan | 132.2 | ₹67,980 Buy1.94 t/s per ₹1k | Community Yuvraj Singh (blog)2026-05-29 |
Each row shows only what its source reported: RAM, quant, prompt speed and setup appear under the main value when published. Rows with full details are listed first, fastest first. Source badges: Community, Vendor, Reproduced; ⚠ marks a speed far from similar results (how we check).