Jihan Yang
Postdoctoral Associate |
|
Biography
I am a postdoctoral associate at NYU Courant, hosted by Prof. Saining Xie. Before that, I received by Ph.D degree from The University of Hong Kong, advised by Prof. Xiaojuan Qi. Prior to that, I obtained my Bachelor's degree from Sun Yat-sen University, supervised by Prof. Liang Lin and Prof. Guanbin Li.
My research interests lie in machine learning and computer vision, with a particular focus on multimodal learning and embodied ai.
News
- [2025/03] Thinking in Space was accepted by CVPR 2025 as Oral.
- [2024/09] Cambrian-1 was accepted by NeurIPS 2024 as Oral.
- [2024/07] V-IRL was accepted by ECCV 2024.
- [2024/05] Lowis3D was accepted by T-PAMI.
- [2024/02] RegionPLC was accepted by CVPR 2024.
- [2023/02] PLA was accepted by CVPR 2023.
- [2022/09] ST3D++ was accepted by T-PAMI.
- [2022/09] SparseKD was accepted by NeurIPS 2022.
- [2022/07] DODA was accepted by ECCV 2022.
Codebase
|
OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Cloud
OpenPCDet Development Team (Core developer) June 2020 [CODE] [Bibtex] 
|
Selected Publications & Preprints [Google Scholar]
*: Equal Contribution
UniTok: A Unified Tokenizer for Visual Generation and Understanding
Chuofan Ma, Yi Jiang, Junfeng Wu, Jihan Yang, Xin Yu, Zehuan Yuan, Bingyue Peng, Xiaojuan Qi
arXiv Preprints
[PDF]
[BLOG]
[CODE]
SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
Tianzhe Chu*, Yuexiang Zhai*, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V. Le, Sergey Levine, Yi Ma
arXiv Preprints
[PDF]
[BLOG]
[CODE]
Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces
Jihan Yang*, Shusheng Yang*, Anjali W. Gupta*, Rilyn Han*, Li Fei-Fei, Saining Xie.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2025
[Oral]
[PDF]
[BLOG]
[CODE]
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
Shengbang Tong*, Ellis Brown*, Penghao Wu*, Sanghyun Woo, Manoj Middepogu, Sai Charitha Akula, Jihan Yang,
Shusheng Yang, Adithya Iyer, Xichen Pan, Austin Wang, Rob Fergus, Yann LeCun, Saining Xie.
Advances in Neural Information Processing Systems (NeurIPS) 2024.
[Oral]
[PDF]
[BLOG]
[CODE]
V-IRL: Grounding Virtual Intelligence in Real Life
Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie.
European Conference on Computer Vision (ECCV), 2024.
[PDF]
[BLOG]
[CODE]
Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding
Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi.
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 2024.
[PDF]
RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding
Jihan Yang*, Runyu Ding*, Weipeng Deng, Zhe Wang, Xiaojuan Qi.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[PDF]
[BLOG]
[CODE]
PLA: Language-driven Open-Vocabulary 3D Scene Understanding
Runyu Ding*, Jihan Yang*, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[PDF]
[BLOG]
[CODE]
Towards Efficient 3D Object Detection with Knowledge Distillation
Jihan Yang, Shaoshuai Shi, Runyu Ding, Zhe Wang, Xiaojuan Qi
Advances in Neural Information Processing Systems (NeurIPS) 2022.
[PDF]
[CODE] 
ST3D++: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
Jihan Yang, Shaoshuai Shi, Zhe Wang, Hongsheng Li, Xiaojuan Qi
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 2022.
[PDF]
[CODE] 
DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Indoor Semantic Segmentation
Runyu Ding*, Jihan Yang*, Xiaojuan Qi
European Conference on Computer Vision (ECCV), 2022.
[PDF]
[CODE] 
Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigation
Ruifei He*, Jihan Yang*, Xiaojuan Qi
IEEE International Conference on Computer Vision (ICCV), 2021.
[Oral]
[PDF]
[CODE] 
ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
Jihan Yang*, Shaoshuai Shi*, Zhe Wang, Hongsheng Li, Xiaojuan Qi
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[PDF]
[CODE]
An adversarial perturbation oriented domain adaptation approach for semantic segmentation
Jihan Yang, Ruijia Xu, Ruiyu Li, Xiaojuan Qi, Xiaoyong Shen, Guanbin Li, Liang Lin
AAAI, 2020.
[PDF]
Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain Adaptation
Ruijia Xu, Guanbin Li, Jihan Yang, Liang Lin
IEEE International Conference on Computer Vision (ICCV), 2019.[Oral]
[PDF]
[CODE] 
Best Paper Award Nomination (one of the seven among 1,075 accepted papers) refer to here.
Experience
-
Courant Institute of Mathematical Sciences, NYU
April 2023 - Aug 2024
Research intern with Prof. Saining Xie -
Autonomous Driving Group, SenseTime
May 2020 - Oct 2020
Research intern with Dr. Zhe Wang -
Youtu Lab, Tencent
Feb 2019 - Feb 2020
Research intern with Dr. Ruiyu Li and Dr. Xiaoyong Shen -
Research Group, YITU Technology
Jul 2018 - Sep 2019
Research intern
Honors & Awards
| 2nd place on 3D detection, 3D tracking and domain adaptation three tracks of Waymo Open Challenges | 2020 |
| Postgraduate Scholarship, HKU | 2020 - 2024 |
| Best Paper Nomination, IEEE International Conference on Computer Vision (0.2%) | 2019 |
| Excellent Graduate Award of Sun Yat-sen University (2%) | 2019 |
| Excellent Dissertations of Sun Yat-sen University (2%) | 2019 |
| First Prize Scholarship of Sun Yat-sen University (4%) | 2017, 2018 |
Academic Services
Conference Reviewer:
- CVPR: 21/22/23/24/25
- ICCV: 21/25
- ECCV: 22/24
- NeurIPS: 23/24
- ICLR: 24/25
- ICML: 25
- IROS: 23
- AAAI: 21
- MM: 24
- IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)
- International Journal of Computer Vision (IJCV)
Teaching
| ELEC3249 Pattern Recognition and Machine Intelligence | 2022-2023 | |
| ENGG1310 Electricity and Electronics | 2021-2022 | |
| ELEC3249 Pattern Recognition and Machine Intelligence | 2020-2021 |