Jetson Orin Nano Super / SmolLM2 1.7B

Can a Jetson Orin Nano Super run SmolLM2 1.7B?

Yes, at a comfortable chat speed. Measured generation speed: 64.5 tok/s across 1 public run.

Rule of thumb: 10+ tok/s feels like a chat; 4–10 is usable for assistants and automations; under 4 is batch-job territory. Speeds depend on quantization, runtime, context length and cooling. Check each source.

BoardQuantRuntimeGen tok/sPrompt tok/sTTFT msSource
Jetson Orin Nano Super
Jetson Orin Nano 8GB (Super mode)
INT4MLC64.5––source ↗
2025-01-16

SmolLM2 1.7B on other boards

Buy a Jetson Orin Nano Super

Ran SmolLM2 1.7B on a Jetson Orin Nano Super? Submit your numbers →

Get the monthly board report

New boards, new runtimes, new numbers. One email a month, no hype.