Query-based cross-modal projector bolsters Mamba multimodal LLM

Arxiv CS.CL (NLP/language models)

Proposes a query-based cross-modal projector to enhance Mamba-based multimodal large language models, addressing Transformer quadratic complexity. Aims to improve multimodal performance while reducing computational load.

mambamultimodal

Arxiv CS.CL (NLP/language models)·SooHwan EomJay ShimGwanhyeong KooHaebin NaMark A. Hasegawa-JohnsonSungwoong KimChang D. Yoo

7 days ago