Todor Mihaylov

About

I am a Staff Research Scientist at Meta Superintelligence Labs, Llama Core Team, where I work on pre-training data curation for large language models. I have contributed to major language model releases including Llama 4, Llama 3, Llama 2, and OPT.

I completed my PhD in Computational Linguistics at the Natural Language Processing Group at Heidelberg University, under the supervision of Prof. Dr. Anette Frank.

Selected Papers

• William Held, Bhargavi Paranjape, Punit Singh Koura, Mike Lewis, Frank Zhang, Todor Mihaylov. Optimizing Pretraining Data Mixtures with LLM-Estimated Utility. arXiv 2025.
• Llama Team at Meta. The Llama 3 Herd of Models. arXiv 2024.
• Llama Team at Meta. Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv 2023.
• Filip Radenovic, Abhimanyu Dubey, Dhruv Mahajan, Vignesh Ramanathan, Laurens van der Maaten, Todor Mihaylov, Deepti Ghadiyaram. Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training. CVPR 2023.
• Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer. OPT: Open Pre-trained Transformer Language Models. arXiv 2022.
• Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona Diab, Zornitsa Kozareva, Ves Stoyanov. Efficient Large Scale Language Modeling with Mixtures of Experts. EMNLP 2021.
• Todor Mihaylov, Peter Clark, Tushar Khot, Ashish Sabharwal. Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering. EMNLP 2018.
• Todor Mihaylov, Anette Frank. Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge. ACL 2018.

Experience

Education