XLM: Cross-lingual Language Model for Multilingual NLP
Back to Writing

XLM: Cross-lingual Language Model for Multilingual NLP

Michael Brenndoerfer•January 21, 2025•11 min read•2,559 words•Interactive

A comprehensive guide to XLM (Cross-lingual Language Model) introduced by Facebook AI Research in 2019. Learn how cross-lingual pretraining with translation language modeling enabled zero-shot transfer across languages and established new standards for multilingual natural language processing.

History of Language AI Cover
Part of History of Language AI

This article is part of the free-to-read History of Language AI book

View full handbook
Reading Level

Choose your expertise level to adjust how many terms are explained. Beginners see more tooltips, experts see fewer to maintain reading flow. Hover over underlined terms for instant definitions.

Loading component...
Loading component...

Reference

BIBTEXAcademic
@misc{xlmcrosslinguallanguagemodelformultilingualnlp, author = {Michael Brenndoerfer}, title = {XLM: Cross-lingual Language Model for Multilingual NLP}, year = {2025}, url = {https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp}, organization = {mbrenndoerfer.com}, note = {Accessed: 2025-11-02} }
APAAcademic
Michael Brenndoerfer (2025). XLM: Cross-lingual Language Model for Multilingual NLP. Retrieved from https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp
MLAAcademic
Michael Brenndoerfer. "XLM: Cross-lingual Language Model for Multilingual NLP." 2025. Web. 11/2/2025. <https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp>.
CHICAGOAcademic
Michael Brenndoerfer. "XLM: Cross-lingual Language Model for Multilingual NLP." Accessed 11/2/2025. https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp.
HARVARDAcademic
Michael Brenndoerfer (2025) 'XLM: Cross-lingual Language Model for Multilingual NLP'. Available at: https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp (Accessed: 11/2/2025).
SimpleBasic
Michael Brenndoerfer (2025). XLM: Cross-lingual Language Model for Multilingual NLP. https://mbrenndoerfer.com/writing/xlm-cross-lingual-language-model-multilingual-nlp
Michael Brenndoerfer

About the author: Michael Brenndoerfer

All opinions expressed here are my own and do not reflect the views of my employer.

Michael currently works as an Associate Director of Data Science at EQT Partners in Singapore, where he drives AI and data initiatives across private capital investments.

With over a decade of experience spanning private equity, management consulting, and software engineering, he specializes in building and scaling analytics capabilities from the ground up. He has published research in leading AI conferences and holds expertise in machine learning, natural language processing, and value creation through data.

Stay updated

Get notified when I publish new articles on data and AI, private equity, technology, and more.