Boards / Jetson AGX Orin
Jetson AGX Orin: LLM benchmarks
The big Orin dev kit. Not cheap, but a useful ceiling for edge numbers.
At a glance
- Measured runs2
- Models tested2
- Fastest run163.9 tok/s
- Llama 3.2 1B, INT4, MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) · source ↗
- Sources1
Where to buy
- Jetson AGX Orin Developer Kit: $3499 raised from $1,999, source ↗ (2026-07-21) Check price (affiliate slot)
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| Llama 3.2 1B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 163.9 | – | – | source ↗ accessed 2026-10-17 |
| Llama 3.2 3B | INT4 | MLC 0.1.2 (dustynv/mlc:0.1.2-r36.3.0) | 80.4 | – | – | source ↗ accessed 2026-10-17 |
Can the Jetson AGX Orin run…
Have this board? Submit your own run →