Boards
Pick a board to see every measured model run, current prices and sources.
Jetson AGX Orin
The big Orin dev kit. Not cheap, but a useful ceiling for edge numbers.
Jetson AGX Thor
NVIDIA's Blackwell-based robotics dev kit, the top of the edge range.
Jetson Orin NX 8GB (Super mode)
Orin NX 8GB module with JetPack 6.2 Super mode.
Jetson Orin NX 16GB (Super mode)
Orin NX 16GB module with JetPack 6.2 Super mode.
Jetson Orin Nano Super
NVIDIA's small CUDA board in its JetPack 6.2 "Super" (25W / MAXN SUPER) power mode.
RK3588 boards (NPU)
The 6-TOPS NPU in Orange Pi 5, Radxa ROCK 5, Indiedroid Nova, ODROID-M2 and friends, driven by RKLLM.
Jetson Orin NX 16GB (original mode)
Orin NX 16GB module in its original power mode.
Jetson Orin Nano (original / mode not stated)
Orin Nano results in the original power mode, or where the source did not state the mode.
Jetson Orin NX 8GB (original mode)
Orin NX 8GB module in its original power mode.
RK3576 boards (NPU)
Rockchip's mid-range SoC with an NPU, found on boards like the Radxa ROCK 4D.
M5Stack AI Pyramid (AX8850)
M5Stack's AX8850-based AI box.
M5Stack LLM8850 M.2 (AX8850)
An AX8850 accelerator on an M.2 card, for adding an NPU to another host.
Pi 5 cluster (distributed-llama)
Several Pi 5 boards splitting one model over Ethernet with distributed-llama.
M5Stack Module LLM (AX630C)
A tiny 54mm module with an Axera AX630C NPU, running StackFlow.
Raspberry Pi 5 (CPU)
The default maker board. LLMs run on the four Cortex-A76 CPU cores with llama.cpp or Ollama.
Pi 5 + AI HAT+ 2 (Hailo-10H)
A Hailo-10H NPU with its own 8GB RAM on a HAT, running Hailo-compiled models through hailo-ollama.
Arduino UNO Q
Arduino's Linux + microcontroller board. Results so far are CPU-only.