Yiming Dou
窦铱明
Hi!
I am a second-year PhD student at the University of Michigan,
advised by Prof. Andrew Owens.
I received my B.Eng. and B.Ec. from Shanghai Jiao Tong University in
2023, with an honors degree from Zhiyuan College.
During my undergraduate, I was fortunate to work with
Prof. Ruohan Gao,
and Prof. Jiajun Wu at Stanford.
Prior to that, I worked closely with Prof. Yong-Lu Li
and Prof. Cewu Lu at SJTU.
My research interests mainly lie in multimodal perception,
reasoning
and robot learning.
I'm happy to make friends with people from various backgrounds.
Feel free to contact my Email or WeChat: 18017112986.
Email  · 
Google Scholar  · 
Twitter  · 
Github
|
|
02/2025:
🎉
One paper accepted to CVPR 2025! See you in Nashville!
01/2025:
🎉
Two papers accepted to ICRA 2025! See you in Atlanta!
09/2024:
🥳
Honored to be selected as an Outstanding Reviewer for ECCV 2024!
02/2024:
🎉
Three papers accepted to CVPR 2024! See you in Seattle!
06/2023:
🥳
Graduated from SJTU with honors degree!
04/2023:
🚀
Selected as SJTU Outstanding Graduate.
04/2023:
🥳
I will join Prof. Andrew Owens's group at the University of Michigan as a PhD student this fall.
Looking forward to the wonderful life in Ann Arbor!
02/2023:
🎉
One paper accepted to CVPR 2023!
|
Humans perceive the world with multiple senses,
based on which we establish abstract concepts to understand it.
From the concepts we develop logical reasoning ability,
and thus creating brilliant achievements.
Inspired by this,
my dream is to design human-like multisensory intelligent systems,
which can be divided into four specific problems:
Multimodal Perception:
how to perceive and model
multimodal information from the world.
Concept Learning:
how to abstract the perceived information into high-level concepts.
Reasoning:
how to perform causal reasoning on the basis of concepts.
Robot Learning:
how to enable robots to actively interact with the real-world environments and humans.
|
Publications
(* indicates equal contribution)
|
|
Hearing Hands: Generating Sounds from Physical Interactions in 3D Scenes
Yiming Dou,
Wonseok Oh,
Yuqing Luo,
Antonio Loquercio,
Andrew Owens
CVPR 2025
Coming soon!
|
|
Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation
Samanta
Rodriguez*,
Yiming Dou*,
Miquel Oller,
Andrew Owens,
Nima Fazeli
In submission
paper
· project page
|
|
Contrastive Touch-to-Touch Pretraining
Samanta
Rodriguez*,
Yiming Dou*,
William van
den Bogert,
Miquel Oller,
Kevin So,
Andrew Owens,
Nima Fazeli
ICRA 2025
paper
· project page
· code
|
|
Tactile Functasets: Neural Implicit Representations of Tactile Datasets
Sikai Li,
Samanta
Rodriguez,
Yiming Dou,
Andrew Owens,
Nima Fazeli
ICRA 2025
paper
· project page
· code
|
|
Tactile-Augmented Radiance Fields
Yiming Dou,
Fengyu Yang,
Yi Liu,
Antonio Loquercio,
Andrew Owens
CVPR 2024
paper
· project page
· code
|
|
Binding Touch to Everything: Learning Unified Multimodal Tactile Representations
Fengyu Yang*,
Chao Feng*,
Ziyang Chen*,
Hyoungseob Park,
Daniel Wang,
Yiming Dou,
Ziyao Zeng,
Xien Chen,
Rit Gangopadhyay,
Andrew Owens,
Alex Wong
CVPR 2024
paper
· project page
· code
|
|
Bridging The Isolated Islands in Human Action Understanding
Yong-Lu Li*,
Xiaoqian Wu*,
Xinpeng Liu,
Yiming Dou,
Yikun Ji,
Junyi Zhang,
Yixing Li,
Jingru Tan,
Xudong Lu,
Cewu Lu
CVPR 2024 (Highlight)
paper
· project page
· code
|
|
The ObjectFolder Benchmark: Multisensory Learning with Neural and Real
Objects
Ruohan Gao*,
Yiming Dou*,
Hao Li*,
Tanmay Agarwal,
Jeannette Bohg,
Yunzhu Li,
Li Fei-Fei,
Jiajun Wu
CVPR 2023
paper
· project page
· code
· interactive demo
· video
|
|
Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactions
Yong-Lu Li*,
Hongwei Fan*,
Zuoyu Qiu,
Yiming Dou,
Liang Xu,
Hao-Shu Fang,
Peiyang Guo,
Haisheng Su,
Dongliang Wang,
Wei Wu,
Cewu Lu
Tech Report
paper
· code
|
Reviewer for ICRA 2025, ICLR 2025, AAAI 2025, ECCV 2024, CVPR 2023-2025, ICCV 2023-2025, ACMMM 2025, ECAI 2025
|
|
University of Michigan
2023.04 ~ Present
Ann Arbor, U.S.
Ph.D. Student in Computer Science and Engineering
Advisor: Prof. Andrew Owens
|
|
Stanford University
2022.03 ~ 2023.04
Stanford, U.S.
Visiting Research Intern
Supervisor: Prof. Jiajun Wu and Prof. Fei-Fei Li
|
|
Shanghai Jiao Tong University
2019.09 ~ 2023.06
Shanghai, China
B.Eng. in Computer Science and Technology
(Summa Cum Laude)
B.Ec. in Economics (Minor)
Member of Zhiyuan Honors Program
Supervisor: Prof. Cewu Lu and Prof. Yong-Lu Li
|
Outstanding Reviewer, ECCV 2024
Zhiyuan Scholarship (top 30 students), SJTU, 2023
SJTU Outstanding Graduate(Special Commendation), SJTU, 2023
SJTU Overseas Scholarship (two winners at SJTU), SJTU, 2022
Academic Excellence Scholarship (top 10%), SJTU, 2022
Zhanjiajun Scholarship (six winners at SJTU), SJTU, 2022
Meritorious Winner (top 7%), MCM, 2022
Merit Student Award (top 5%), SJTU, 2021
Zhiyuan Honors Scholarship
(top 5%), SJTU, 2019-2022
|
|