NVIDIA releases Nemotron-TwoTower diffusion LM

Arxiv CS.CL (NLP/language models)

Nemotron-TwoTower-30B-A3B-Base-BF16 is a diffusion language model using a frozen autoregressive context tower plus a diffusion denoiser tower for iterative generation. Built on the Nemotron 3 Nano 30B-A3B backbone, it offers parallel generation capability.

NvidiaDiffusion

See 1 more source

NVIDIA has released Nemotron-TwoTower-30B-A3B-Base-BF16, an unusual diffusion-based language model built from the Nemotron 3 Nano 30B-A3B backbone.1 day agonikhilprasanthDiscuss

Arxiv CS.CL (NLP/language models)·Fitsum RedaJohn KamaluRoger WaleffeMostofa PatwaryMohammad ShoeybiBryan Catanzaro

Jun 26, 4:00 AM