Puget Systems tests dual AMD Radeon AI PRO R9700 for local LLM inference

Puget Systems benchmarked two AMD Radeon AI PRO R9700 GPUs (32GB GDDR6 each, 640 GB/s bandwidth) for local LLM inference and image generation, finding stock vLLM multi-GPU does not work on these cards. The R9700 costs ~$1,880 (MSRP $1,299), undercutting the RTX 5090 (~$4,130) while matching its VRAM capacity.
1 source
Developers by email
Get an email when there's news on Developers
No news that day, no email.
More stories today
- AI startup Wonderful raises funds at $5 billion valuation
- NYC bans AI use for students until high school
- Qwen Live Host v0.2.0 released
- Filevine launches AI citator and hallucination checker in LOIS
- AI billionaires fund ad blitz as data center opposition hits 61%