About & methodology
EdgeLLM Bench collects publicly posted local-LLM benchmark results for edge boards. We only record numbers present in the source; fields a source didn't report are simply left out rather than guessed. "Prompt t/s" is prompt processing (usually llama-bench pp512); "Gen t/s" is token generation (usually tg128). Results from different runtimes, threads, and cooling are not strictly comparable. Check each source.
Last verified 2026-10-17: every result was re-checked against its cited source and corrected where it differed; India prices were re-checked on retailer pages the same day (Robu.in blocks automated checks, so its prices are from 2026-10-16).
Affiliate disclosure (placeholder): some "where to buy" links will be affiliate links; they never affect rankings.
Sponsorship: any paid placement is labelled (for example a "Featured" badge on a store row) and never changes benchmark numbers, rankings or price order. See Advertise.
How we label and check results
Every row carries a source badge:
- Community posted by an individual: GitHub repos and gists, Reddit, forums, personal blogs. Self-reported; we check the number matches the source but have not re-run it.
- Vendor published by a board or platform maker (for example NVIDIA Jetson AI Lab, Turing Pi, PicoCluster). Often tuned, may be best-case.
- Reproduced re-run by EdgeLLM Bench on our own hardware. None yet.
⚠ unusual, check source: a row is marked when its generation speed is more than 2x or less than half the median of at least 3 results on the same board and model size class (1–5B, 5–11B, 12B+), compared within the same quant-bit group (≤3, 4–5, 6–8 bit) when there are enough results. Flagged rows are not hidden or removed; they may reflect a different runtime, NPU/GPU use or settings. Hover the marker to see the comparison.
New submissions must include pasted raw output (llama-bench or ollama --verbose); results without it are not added.
Sources & credits
- hammad93 (GitHub gist): https://gist.github.com/hammad93/eab28862024e480a2046d51bc39bd462/7e502ea4019400a75f4fc5c369992b273f2a5398
- Mojo24x7/rk-llama.cpp: https://github.com/Mojo24x7/rk-llama.cpp
- davidscarth (edge-ai-study): https://github.com/davidscarth/edge-ai-study/blob/main/RASPI5.md
- llama.cpp discussion #30069 author: https://github.com/ggml-org/llama.cpp/discussions/30069
- llama.cpp issue #7176 author: https://github.com/ggml-org/llama.cpp/issues/7176
- kim-haneol (Strata-Orin): https://github.com/kim-haneol/Strata-Orin/blob/main/docs/OPTIMIZATION.md
- milhcbt/rk-llama.cpp: https://github.com/milhcbt/rk-llama.cpp
- jishuzhan.net author: https://jishuzhan.net/article/2099289570509246466
- Thomas Nahon (Medium): https://medium.com/@thomasnahon/llms-on-a-budget-testing-serving-frameworks-on-the-raspberry-pi-4-5fc56623840e
- PicoCluster Claw: https://picocluster-claw.com/reference/benchmarks/
- Turing Pi blog: https://turingpi.com/lfm2-5-2-6b-rk3588-llama-cpp-turing-pi-rk1/
- NVIDIA Jetson AI Lab: https://www.jetson-ai-lab.com/archive/benchmarks.html
- r/LocalLLaMA commenter: https://www.reddit.com/r/LocalLLaMA/comments/19444pu/phi2_tiny_llama_on_raspberry_pi_5/
- r/LocalLLaMA thread author: https://www.reddit.com/r/LocalLLaMA/comments/19444pu/phi2_tiny_llama_on_raspberry_pi_5/
- r/LocalLLaMA user jwest33: https://www.reddit.com/r/LocalLLaMA/comments/1oo88sq/nvidia_jetson_orin_nano_super_8_gb_llamabench/
- r/LocalLLaMA thread author (Cougar): https://www.reddit.com/r/LocalLLaMA/comments/1s34zsg/161_toks_on_raspberry_pi_5_bitnet_2b_can_anyone/
- r/LocalLLaMA thread author: https://www.reddit.com/r/LocalLLaMA/comments/1sdcdno/benchmarks_of_gemma4_and_multiple_others_on/
- Timothy Lewis (@tolewis on X): https://x.com/tolewis/status/2112240842861641996
- Yuvraj Singh (blog): https://yuvrajsingh.io/posts/jetson-nano-super-benchmark-non-reasoning/
Dataset: results.json · results.csv