Todor Mihaylov

About

I am a Staff Research Scientist at Meta Superintelligence Labs where I work on pre-training data curation for large language models. I have contributed to major language model releases including Llama 4, Llama 3, Llama 2, and OPT.

Selected Papers

• William Held, Bhargavi Paranjape, Punit Singh Koura, Mike Lewis, Frank Zhang, Todor Mihaylov. Optimizing Pretraining Data Mixtures with LLM-Estimated Utility. arXiv 2025.
• Llama Team at Meta. The Llama 3 Herd of Models. arXiv 2024.
• Llama Team at Meta. Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv 2023.
• Filip Radenovic*, Abhimanyu Dubey*, Abhishek Kadian*, Todor Mihaylov*, Simon Vandenhende*, Yash Patel, Yi Wen, Vignesh Ramanathan, Dhruv Mahajan Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training. CVPR 2023.
• Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer. OPT: Open Pre-trained Transformer Language Models. arXiv 2022.
• Mikel Artetxe*, Shruti Bhosale*, Naman Goyal*, Todor Mihaylov*, Myle Ott*, Sam Shleifer*, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona Diab, Zornitsa Kozareva, Ves Stoyanov. Efficient Large Scale Language Modeling with Mixtures of Experts. EMNLP 2021.

Experience

Education