Boards / Raspberry Pi 5 cluster
Pi 5 cluster (distributed-llama): LLM benchmarks
Several Pi 5 boards splitting one model over Ethernet with distributed-llama.
At a glance
- Measured runs2
- Models tested1
- Fastest run13.68 tok/s
- Llama 3.2 3B Instruct, Q40, distributed-llama v0.12.3 · source ↗
- Sources1
Where to buy
- Raspberry Pi 5 8GB (per node): $175 multiply by node count, source ↗ (2026-04-01) Check price on Amazon
Every run on this board
| Model | Quant | Runtime | Gen tok/s | Prompt tok/s | TTFT ms | Source |
|---|---|---|---|---|---|---|
| Llama 3.2 3B Instruct | Q40 | distributed-llama v0.12.3 | 13.68 | 27.74 | – | source ↗ 2025-02-15 |
| Llama 3.2 3B Instruct | Q40 | distributed-llama v0.12.3 | 10.33 | 23.63 | – | source ↗ 2025-02-15 |
Can the Raspberry Pi 5 cluster run…
Have this board? Submit your own run →