Runpei Dong | 董润沛

  Incoming Ph.D. Student

  Department of Computer Science

  University of Illinois at Urbana-Champaign

  Email: runpeid2 [AT]

  Google Scholar / DBLP / GitHub / LinkedIn

News | Publications | Software | Honors | Services

I am an incoming Ph.D. student in Computer Science at UIUC, advised by Prof. Saurabh Gupta and Prof. Ashish Kumar.

Prior to this, I got my MS degree in Computer Science through a joint training at Xi'an Jiaotong University & IIIS, Tsinghua University, under the supervision of Prof. Andrew Chi-Chih Yao. I am fortunate to collaborate closely with Prof. Kaisheng Ma, Prof. Li Yi and Prof. He Wang.

I enjoy working on interesting and cool things that fascinate me, and I am currently working on scalable & human-centered robot learning, embodied intelligence, and generative models. I am enthusiastic about contributing to the research community and I support Slow Science.


  • [2024/07] One paper accepted to ECCV 2024.
  • [2024/04] I will be attending ICLR 2024 in person, see you in 🇦🇹Austria!
  • [2024/04] One paper accepted to IJCAI 2024 as Long Oral presentation and one paper acccepted to RA-L.
  • [2024/01] One paper accepted to ICLR 2024 as Spotlight presentation.
  • [2023/11] Honorably selected as NeurIPS 2023 Top Reviewer.
  • [2023/09] One paper accepted to NeurIPS 2023.
  • [2023/09] Introduce multimodal LLM: DreamLLM
  • [2023/09] Invited talk on multimodal foundation models at Tsinghua University and Xi'an Jiaotong University.
  • [2023/04] I will be attending ICLR 2023 in person, see you in 🇷🇼Rwanda!
  • [2023/04] One paper accepted to ICML 2023.
  • [2023/03] Invited talk on 3D representation learning at Tsinghua University.
  • [2023/03] One paper accepted to CVPR 2023.
  • [2023/01] One paper accepted to ICLR 2023.
  • [2022/09] I join Megvii (Foundation Model Group) as a research intern.
  • [2022/06] One paper accepted to ECCV 2022 as Oral presentation.
  • [2021/12] One paper accepted to ICML 2022 as Spotlight presentation.
  • [2021/06] One paper accepted to ISCA 2021.

Featured Publications

*: Equal contribution. See also my Google Scholar profile for the most recent publications.

More Publications

: Project leader; : Corresponding author.

new DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation
Yuang Peng*, Yuxin Cui*, Haomiao Tang*, Zekun Qi, Runpei Dong, Jing Bai, Chunrui Han, Zheng Ge, Xiangyu Zhang, Shu-Tao Xia
PDF / Project / Code / DreamBench++ Benchmark / Data

new ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
Zekun Qi, Runpei Dong, Shaochen Zhang, Haoran Geng, Chunrui Han, Zheng Ge, He Wang, Li Yi, Kaisheng Ma
ECCV 2024 / PDF / Project / Code / 3D MM-Vet Benchmark / Data

ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning
Liang Zhao*, En Yu*, Zheng Ge, Jinrong Yang, Haoran Wei, Hongyu Zhou, Jianjian Sun, Yuang Peng, Runpei Dong, Chunrui Han, Xiangyu Zhang
IJCAI 2024 / PDF / Demo
Long Oral Presentation (4%)

Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception
Chunrui Han, Jianjian Sun, Zheng Ge, Jinrong Yang, Runpei Dong, Hongyu Zhou, Weixin Mao, Yuang Peng, Xiangyu Zhang
IEEE RA-L with a presentation at IROS 2024 / PDF
Oral Presentation at IROS

VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation
Zekun Qi*, Muzhou Yu*, Runpei Dong, Kaisheng Ma
NeurIPS 2023 / PDF / Code

CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIP
Junbo Zhang, Runpei Dong, Kaisheng Ma
ICCV 2023 @ OpenSUN3D / PDF

PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
Linfeng Zhang*, Runpei Dong*, Hung-Shuo Tai, Kaisheng Ma
CVPR 2023 / PDF / Code

Region-aware Knowledge Distillation for Efficient Image-to-Image Translation
Linfeng Zhang, Xin Chen, Runpei Dong, Kaisheng Ma
BMVC 2023 / PDF / Code

CORSD: Class-Oriented Relational Self Distillation
Muzhou Yu, Sia Huat Tan, Kailu Wu, Runpei Dong, Linfeng Zhang, Kaisheng Ma

Contrastive Deep Supervision
Linfeng Zhang, Xin Chen, Junbo Zhang, Runpei Dong, Kaisheng Ma
ECCV 2022 / PDF / Code / Slides
Oral Presentation (2.7%)

Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks
Runpei Dong*, Zhanhong Tan*, Mengdi Wu, Linfeng Zhang, Kaisheng Ma
ICML 2022 / PDF / Code / Slides
Spotlight Presentation

Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention
Sia Huat Tan, Runpei Dong, Kaisheng Ma
BMVC 2021 / PDF / Code

NN-Baton: DNN Workload Orchestration and Chiplet Granularity Exploration for Multichip Accelerators
Zhanhong Tan, Hongyu Cai, Runpei Dong, Kaisheng Ma
ISCA 2021 / PDF

Data & Software
Professional Services
  • Program committee or conference reviewer