AnalysisAI ModelsJuly 14, 2026

Bonsai 27B runs on Jetson Orin Nano 8GB at 4.31 t/s

Bonsai 27B achieves 4.31 tokens/s on a Jetson Orin Nano 8GB with 48k context. RAM usage is 6.2GB with model loaded, making it a viable edge AI setup at ~25W.

1 source

More stories today

Open the live feed