Back to AIBriefs
LaunchDevelopers

Unsloth releases North-Mini-Code GGUF quant for Cohere 30B A3B

Unsloth releases North-Mini-Code GGUF quant for Cohere 30B A3Bhuggingface.co

GGUF quantization of Cohere's 30B-parameter A3B code model North-Mini-Code, with 3B active parameters, for local inference via llama.cpp. Built by Unsloth, enables running a large code model on consumer hardware.

··Discuss
Jun 10, 4:14 AM
Unsloth releases North-Mini-Code GGUF quant for Cohere 30B A3B — AIBriefs