EXL3 quants run dense 30B model on 12GB VRAM

A Reddit thread on r/LocalLLaMA with 111 points and 10 comments discusses benchmarks that major AI labs allegedly don't want publicized. The post has no additional details.

Crusoe, a cloud-computing provider and data center developer working with OpenAI, Microsoft, and Meta, raised over $3 billion in a funding round valuing it at roughly $30 billion.

Nell Minow, Chair of ValueEdge Advisors, says Anthropic is moving in the opposite direction from SpaceX on governance, but argues its structure is still unusual and potentially problematic. She says the company is combining elements of public companies and nonprofits, including a public benefit.