Tencent HunyuanAnalysisAI ModelsJuly 10, 2026

Tencent releases HiLS-Attention-7B with chunk-wise sparse attention

Read original source →huggingface.co

HiLS-Attention is a chunk-wise sparse attention mechanism that learns chunk selection end-to-end under language-modeling loss. The 7B checkpoint is continued-trained on an OLMo3-style base and enables efficient long-context modeling.

1 source

More stories today

Open the live feed