Tencent releases HiLS-Attention-7B with chunk-wise sparse attention

HiLS-Attention is a chunk-wise sparse attention mechanism that learns chunk selection end-to-end under language-modeling loss. The 7B checkpoint is continued-trained on an OLMo3-style base and enables efficient long-context modeling.