Ruizhe Wang

Ruizhe Wang

USTC - MSRA Joint Ph.D. Candidate

Hi, I’m Ruizhe Wang (王瑞哲), currently pursuing a joint Ph.D. program between University of Science and Technology and China (USTC) and Microsoft Research Asia (MSRA), co-supervised by Professor Zhengjun Zha (查正军) and Professor Baining Guo (郭百宁). I received my Bachelor of Engineering degree in Electronic Information Engineering from University of Science and Technology of China. I also collaborate with Peng Cheng (程鹏) and Yeyun Gong (宫叶云) from Microsoft Research Asia.

My research interest are AI Infrastructure, Large Language Model (LLM) Pretraining, and Efficient AI System Designing. I enjoy building scalable models, exploring novel training methods, and solving challenging problems at the intersection of theory and practice. Currently, I work on developing high-performance machine learning infrastructure and advancing the capabilities of large language models.

In my free time, I enjoy sharing knowledge, contributing to open-source projects, and staying curious about emerging technologies. For more info related to my research, please refer to my google scholar homepage

📖 Educations

  • 2023.09 - now, PhD Candidate, University of Science and Technology of China, Department of Automation
  • 2019.09 - 2023.06, Bachelor’s Degree, University of Science and Technology of China, Department of Electronic Engineering and Information Science
  • 2016.09 - 2019.06, Hefei No.8 Senior High School

🦈 Blogs

📝 Publications

ICML 2025
sym

Optimizing Large Language Model Training Using FP4 Quantization

Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng

sym

FP8-LM: Training FP8 Large Language Models

Houwen Peng, Kan Wu, Yixuan Wei, Guoshuai Zhao, Yuxiang Yang, Ze Liu, Yifan Xiong, Ziyue Yang, Bolin Ni, Jingcheng Hu, Ruihang Li, Miaosen Zhang, Chen Li, Jia Ning, Ruizhe Wang, Zheng Zhang, Shuguang Liu, Joe Chau, Han Hu, Peng Cheng

🏆 Honors and Awards

  • 2023.06 : Outstanding graduates of USTC.
  • 2022.09 : China National Scholarship.
  • 2019.09/2020.09/2021.09 : Scholarships for the Elites Program of USTC.

💻 Internships