Multilingual LLM research reveals language anchoring and cross-lingual transfer challenges

Arxiv CS.CL (NLP/language models)

A study fine-tuning seven LLMs (4B–671B params) on Arabic finds zero-shot reading comprehension in Semitic languages depends on both linguistic relatedness and task alignment. Another paper shows code-switching degrades performance compared to monolingual inputs, indicating language anchoring in multilingual models.

MultilingualLLM

See 11 more sources

Disentangling Linguistic Relatedness from Task Alignment in Cross-Lingual Transfer4 days agoAhmed Haj Ahmed, Ruochen Zhang, Alvin Grissom II

Where to Place the Query? Unveiling and Mitigating Positional Bias in In-Context Learning for Diffusion LLMs via Decoding Dynamics4 days agoZhengheng Li, Panrui Li, Xuyang Liu, Puzhi Xia

Quantifying Aleatoric Uncertainty of In-Context Learning for Robust Measure of LLM Prediction Confidence4 days agoJinseok Chung, Minkyoung Song, Hyunji Jung, Namhoon Lee

LLM Parameters for Math Across Languages: Shared or Separate?5 days agoBehzad Shomali, Luisa Victor, Tim Selbach, Ali Hamza Bashir, David Berghaus, Joachim Koehler, Mehdi Ali, Markus Frey

G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment5 days agoFengying Ye, Yanming Sun, Runzhe Zhan, Zheqi Zhang, Lidia S. Chao, Derek F. Wong

Enhancing Multilingual Reasoning via Steerable Model Merging5 days agoZhuoran Li, Rui Xu, Jian Yang, Junnan Liu, Zhijun Chen, Qianren Mao, Hongcheng Guo, Jiaheng Liu, Likang Xiao, Ming Li, Xiaojie Wang

Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition5 days agoShiho Matta, Yin Jou Huang, Fei Cheng, Takashi Kodama, Hirokazu Kiyomaru, Yugo Murawaki

Speaking in Self-Assessing Tongues: On the Verbalized Confidence of LLMs in Machine Translation5 days agoAli Marashian, Alexis Palmer, Katharina von der Wense

Are you speaking my languages? On spoken language adherence in multimodal LLMs6 days agoHyungwon Kim, Kandarp Joshi, Lillian Zhou, Pavel Golik, Petar Aleksic

When English Isn't the Best Teacher: Source Language Effects in Cross-Lingual In-Context Learning5 days agoFred Philippy, Siwen Guo, Jacques Klein, Tegawend\'e F. Bissyand\'e

Translating the Untranslatable: An Operationalizable Ontology for Untranslatability5 days agoJacob Bremerman, Brihi Joshi, Hirona Arai, Xiang Ren, Jonathan May

Arxiv CS.CL (NLP/language models)·Jeonghyun ParkSeunghyun YoonYonghyun JunHwanhee Lee

Jun 19, 4:00 AM