Back to AIBriefs
LaunchAI Models

SubQuadratic AI unveils SubQ-1.1-Small with Smart Sparse Attention

SubQuadratic AI unveils SubQ-1.1-Small with Smart Sparse Attentionsubq.ai

Achieves near-perfect long-context retrieval up to 12M tokens with up to 1000x reduction in attention compute. The model uses a novel Smart Sparse Attention mechanism.

··Discuss
4 hours ago
SubQuadratic AI unveils SubQ-1.1-Small with Smart Sparse Attention — AIBriefs