Untied Ulysses technique trains with 3M-token context

Max Ryabinin (Together AI) presents Untied Ulysses, a method enabling 3M-token context training on a single 8xH100 node. The technique scales to 8B and 32B parameters with 25% longer sequences than standard approaches.