Rockchip RK3588 / TeleChat2 3B

Can a Rockchip RK3588 run TeleChat2 3B?

Yes, at a comfortable chat speed. Measured generation speed: 10.18 tok/s across 1 public run.

Rule of thumb: 10+ tok/s feels like a chat; 4–10 is usable for assistants and automations; under 4 is batch-job territory. Speeds depend on quantization, runtime, context length and cooling. Check each source.

BoardQuantRuntimeGen tok/sPrompt tok/sTTFT msSource
Rockchip RK3588
Rockchip RK3588 (vendor reference board)
w8a8RKLLM v1.3.110.18–618.48source ↗
commit 2026-09-29

TeleChat2 3B on other boards

Buy a Rockchip RK3588

Ran TeleChat2 3B on a Rockchip RK3588? Submit your numbers →

Get the monthly board report

New boards, new runtimes, new numbers. One email a month, no hype.