👨‍🎓 About Me

Hi! I am currently a master student at Intelligent Transportation Lab, Institute of Systems Engineering, Department of Automation, Tsinghua University, advised by Prof. Jianming Hu. Additionally, I work as a research intern at AIR-DREAM Lab of Institute for AI Industry Research (AIR), Tsinghua University, advised by Prof. Xianyuan Zhan. I am also fortunate to work closely with Prof. Dorsa Sadigh at Stanford. I got my bachelor’s degree in June 2022 from the Department of Automation, Tsinghua University.

My research interest broadly lies in advanced data-driven learning theory and algorithms on decision making and optimization, such as reinforcement learning (RL), as well as their promising applications on autonomous driving and robotics. However, over recent years, criticism against RL continues to pour regarding its limited real-world applicability. Specifically, I therefore pay much attention to bridging the complex and intractable sim-to-real gaps that potentially deteriorate RL policies, seeking more practical solutions for real-world deployment.

🔥 News

  • [2024.01] One paper is accepted by ICRA 2024!
  • [2023.10] Two papers are accepted by NeurIPS 2023 Symposium on ML4AD and ALOE Workshop!
  • [2023.03] One paper is accepted by IEEE IV 2023!
  • [2023.02] Guest Speaker at 2023 AI TIME Youth PhD Talk Forum.
  • [2022.11] Invited talk about our NeurIPS paper (H2O) at RLChina Academic Seminar! [video]
  • [2022.11] Invited talk about our NeurIPS paper (H2O) at DI Lab’s group meeting!
  • [2022.10] One paper is accepted by NeurIPS 2022 RL4RealLife Workshop and ML4AD Workshop!
  • [2022.09] One paper is accepted by NeurIPS 2022!
  • [2022.09] One paper is accepted by CoRL 2022!

📝 Publications

Preprints and Codebases

Conference Proceedings


🎖 Honors and Awards

  • [2024.01] Weimin Zheng Scholarship
  • [2023.10] Tsinghua First-Class Comprehensive Excellence Award for Graduate Students (Lingjun Investment Scholarship)
  • [2022.06] Tsinghua Outstanding Graduate Dissertation (top 5%)
  • [2022.06] Tsinghua Outstanding Graduate Award (top 10%)
  • [2022.06] Excellent Graduate Award of Department of Automation, Tsinghua University
  • [2021.12] Best Paper Award at COTA International Conference of Transportation Professionals (CICTP)
  • [2021.09] Tsinghua “Future Scholar” Scientific Research Grant (9/3850 in Tsinghua Class of 2022)
  • [2021.04] Second Prize in Tsinghua “Challenge Cup” Academic Science and Technology Competition
  • [2020.12] First Prize in Tsinghua Excellent Student Research Training (SRT) Program (top 1%, 12/1250)
  • [2020.10] Tsinghua Comprehensive Excellence Award (top 10%, 15/179)
  • [2020.10] Fang Chongzhi Scholarship (highest scholarship for juniors in Dept. of Automation, 1/179)
  • [2019.12] First Prize in Group A (Non-Physics Major) of the National Collegiate Physics Competition

📖 Educations

  • 2022.08 - Present, Master, Department of Automation, Tsinghua University, Beijing, China.
  • 2018.08 - 2022.06, Undergraduate, Department of Automation, Tsinghua Univeristy, Beijing, China.
  • 2015.08 - 2018.06, High School Attached to Northeast Normal University, Changchun, Jilin, China.

💻 Internships

🧑‍🎨 Services

Reviewer for Conferences (ITSC, ICRA, IROS, IJCAI, NeurIPS, ICML) and Journals (IEEE Transactions on Intelligent Vehicles, Transportation Research Part C).