Boards / Jetson Orin NX 16GB Super
Jetson Orin NX 16GB (Super mode): LLM benchmarks
Orin NX 16GB module with JetPack 6.2 Super mode.
At a glance
- Measured runs7
- Models tested7
- Fastest run68.8 tok/s
- SmolLM2 1.7B, INT4, MLC · source ↗
- Sources1
Where to buy
- Jetson Orin NX 16GB module (Super mode): price not verified yet Check price on AmazonBuy at Seeed Studio
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| SmolLM2 1.7B | INT4 | MLC | 68.8 | – | – | source ↗ 2025-01-16 |
| Llama 3.2 3B | INT4 | MLC | 45.8 | – | – | source ↗ 2025-01-16 |
| Phi-3.5 3.8B | INT4 | MLC | 40.9 | – | – | source ↗ 2025-01-16 |
| Gemma 2 2B | INT4 | MLC | 39 | – | – | source ↗ 2025-01-16 |
| Qwen2.5 7B | INT4 | MLC | 23.5 | – | – | source ↗ 2025-01-16 |
| Llama 3.1 8B | INT4 | MLC | 22.8 | – | – | source ↗ 2025-01-16 |
| Gemma 2 9B | INT4 | MLC | 13.26 | – | – | source ↗ 2025-01-16 |
Can the Jetson Orin NX 16GB Super run…
Can it run Gemma 2 2B?Can it run Gemma 2 9B?Can it run Llama 3.1 8B?Can it run Llama 3.2 3B?Can it run Phi-3.5 3.8B?Can it run Qwen2.5 7B?Can it run SmolLM2 1.7B?
Have this board? Submit your own run →