AnalysisAI ModelsJuly 11, 2026

Hy3 (295B MoE) and Nemotron-Labs-Audex-30B-A3B GGUF quants shared

A Reddit user shared GGUF quantized versions of Hy3 (295B MoE) and NVIDIA's Nemotron-Labs-Audex-30B-A3B (30B audio-capable MoE). The quants use imatrix quantization, with KLD/PPL measurements against BF16 reference logits and llama-bench throughput numbers. All raw benchmark data is included in the repos for reproducibility.

1 source

More stories today

Open the live feed
Hy3 (295B MoE) and Nemotron-Labs-Audex-30B-A3B GGUF quants shared — AIBriefs