Runpei Dong | 董润沛

  Incoming Ph.D. Student

  Department of Computer Science

  University of Illinois at Urbana-Champaign

  Email: runpeid2 [AT] illinois.edu

  Google Scholar / DBLP / GitHub / LinkedIn


News | Publications | Software | Honors | Services


I am an incoming Ph.D. student in Computer Science at UIUC, advised by Prof. Saurabh Gupta and Prof. Ashish Kumar.

Prior to this, I got my MS degree in Computer Science through a joint training at Xi'an Jiaotong University & IIIS, Tsinghua University, under the supervision of Prof. Andrew Chi-Chih Yao. I am fortunate to collaborate closely with Prof. Kaisheng Ma, Prof. Li Yi and Prof. He Wang.

I enjoy working on interesting and cool things that fascinate me, and I am currently working on scalable & human-centered robot learning, embodied intelligence, and generative models. I am enthusiastic about contributing to the research community and I support Slow Science.

News

  • [2024/07] One paper accepted to ECCV 2024.
  • [2024/04] I will be attending ICLR 2024 in person, see you in 🇦🇹Austria!
  • [2024/04] One paper accepted to IJCAI 2024 as Long Oral presentation and one paper acccepted to RA-L.
  • [2024/01] One paper accepted to ICLR 2024 as Spotlight presentation.
  • [2023/11] Honorably selected as NeurIPS 2023 Top Reviewer.
  • [2023/09] One paper accepted to NeurIPS 2023.
  • [2023/09] Introduce multimodal LLM: DreamLLM
  • [2023/09] Invited talk on multimodal foundation models at Tsinghua University and Xi'an Jiaotong University.
  • [2023/04] I will be attending ICLR 2023 in person, see you in 🇷🇼Rwanda!
  • [2023/04] One paper accepted to ICML 2023.
  • [2023/03] Invited talk on 3D representation learning at Tsinghua University.
  • [2023/03] One paper accepted to CVPR 2023.
  • [2023/01] One paper accepted to ICLR 2023.
  • [2022/09] I join Megvii (Foundation Model Group) as a research intern.
  • [2022/06] One paper accepted to ECCV 2022 as Oral presentation.
  • [2021/12] One paper accepted to ICML 2022 as Spotlight presentation.
  • [2021/06] One paper accepted to ISCA 2021.

Featured Publications

*: Equal contribution. See also my Google Scholar profile for the most recent publications.



More Publications

: Project leader; : Corresponding author.

new DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation
Yuang Peng*, Yuxin Cui*, Haomiao Tang*, Zekun Qi, Runpei Dong, Jing Bai, Chunrui Han, Zheng Ge, Xiangyu Zhang, Shu-Tao Xia
PDF / Project / Code / DreamBench++ Benchmark / Data

new ShapeLLM: Universal 3D Object Understanding for Embodied Interaction
Zekun Qi, Runpei Dong, Shaochen Zhang, Haoran Geng, Chunrui Han, Zheng Ge, He Wang, Li Yi, Kaisheng Ma
ECCV 2024 / PDF / Project / Code / 3D MM-Vet Benchmark / Data

ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning
Liang Zhao*, En Yu*, Zheng Ge, Jinrong Yang, Haoran Wei, Hongyu Zhou, Jianjian Sun, Yuang Peng, Runpei Dong, Chunrui Han, Xiangyu Zhang
IJCAI 2024 / PDF / Demo
Long Oral Presentation (4%)

Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception
Chunrui Han, Jianjian Sun, Zheng Ge, Jinrong Yang, Runpei Dong, Hongyu Zhou, Weixin Mao, Yuang Peng, Xiangyu Zhang
IEEE RA-L with a presentation at IROS 2024 / PDF
Oral Presentation at IROS

VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation
Zekun Qi*, Muzhou Yu*, Runpei Dong, Kaisheng Ma
NeurIPS 2023 / PDF / Code

CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIP
Junbo Zhang, Runpei Dong, Kaisheng Ma
ICCV 2023 @ OpenSUN3D / PDF

PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
Linfeng Zhang*, Runpei Dong*, Hung-Shuo Tai, Kaisheng Ma
CVPR 2023 / PDF / Code

Region-aware Knowledge Distillation for Efficient Image-to-Image Translation
Linfeng Zhang, Xin Chen, Runpei Dong, Kaisheng Ma
BMVC 2023 / PDF / Code

CORSD: Class-Oriented Relational Self Distillation
Muzhou Yu, Sia Huat Tan, Kailu Wu, Runpei Dong, Linfeng Zhang, Kaisheng Ma
ICASSP 2023 / PDF

Contrastive Deep Supervision
Linfeng Zhang, Xin Chen, Junbo Zhang, Runpei Dong, Kaisheng Ma
ECCV 2022 / PDF / Code / Slides
Oral Presentation (2.7%)

Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks
Runpei Dong*, Zhanhong Tan*, Mengdi Wu, Linfeng Zhang, Kaisheng Ma
ICML 2022 / PDF / Code / Slides
Spotlight Presentation

Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention
Sia Huat Tan, Runpei Dong, Kaisheng Ma
BMVC 2021 / PDF / Code

NN-Baton: DNN Workload Orchestration and Chiplet Granularity Exploration for Multichip Accelerators
Zhanhong Tan, Hongyu Cai, Runpei Dong, Kaisheng Ma
ISCA 2021 / PDF

Data & Software
Honors
Professional Services
  • Program committee or conference reviewer