Jihan Yang

Postdoctoral Associate
Courant Institute of Mathematical Sciences
New York University

Email: jihanyang [at] nyu [dot] edu

[Google Scholar] [GitHub] [Twitter]

Biography

I am a postdoctoral Associate at NYU Courant, hosted by Prof. Saining Xie. Before that, I received by Ph.D degree from The University of Hong Kong, advised by Prof. Xiaojuan Qi. Prior to that, I obtained my Bachelor's degree from Sun Yat-sen University, supervised by Prof. Liang Lin and Prof. Guanbin Li.

My research interests lie in machine learning and computer vision, with a particular focus on multi-modality and embodied AI.

News

[2024/09] Cambrian-1 was accepted by NeurIPS 2024 as Oral
[2024/07] V-IRL was accepted by ECCV 2024
[2024/05] Lowis3D was accepted by T-PAMI
[2024/02] RegionPLC was accepted by CVPR 2024.
[2023/02] PLA was accepted by CVPR 2023.
[2022/09] ST3D++ was accepted by T-PAMI.
[2022/09] SparseKD was accepted by NeurIPS 2022.
[2022/07] DODA was accepted by ECCV 2022.

Codebase

OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Cloud

OpenPCDet Development Team (Core developer)
June 2020

[CODE] [Bibtex]


@misc{openpcdet2020,
    title={OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds},
    author={OpenPCDet Development Team},
    howpublished = {\url{https://github.com/open-mmlab/OpenPCDet}},
    year={2020}
}

Selected Publications [Google Scholar]

*: Equal Contribution

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs
Shengbang Tong*, Ellis Brown*, Penghao Wu*, Sanghyun Woo, Manoj Middepogu, Sai Charitha Akula, Jihan Yang, Shusheng Yang, Adithya Iyer, Xichen Pan, Austin Wang, Rob Fergus, Yann LeCun, Saining Xie.

Advances in Neural Information Processing Systems (NeurIPS) 2024. (Oral)
[PDF] [BLOG] [CODE]

V-IRL: Grounding Virtual Intelligence in Real Life
Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie.

European Conference on Computer Vision (ECCV), 2024.
[PDF] [BLOG] [CODE]

Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understanding
Runyu Ding, Jihan Yang, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi.

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 2024.
[PDF]

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding
Jihan Yang*, Runyu Ding*, Weipeng Deng, Zhe Wang, Xiaojuan Qi.

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[PDF] [BLOG] [CODE]

PLA: Language-driven Open-Vocabulary 3D Scene Understanding
Runyu Ding*, Jihan Yang*, Chuhui Xue, Wenqing Zhang, Song Bai, Xiaojuan Qi.

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[PDF] [BLOG] [CODE]

Towards Efficient 3D Object Detection with Knowledge Distillation
Jihan Yang, Shaoshuai Shi, Runyu Ding, Zhe Wang, Xiaojuan Qi

Advances in Neural Information Processing Systems (NeurIPS) 2022.
[PDF] [CODE]

ST3D++: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
Jihan Yang, Shaoshuai Shi, Zhe Wang, Hongsheng Li, Xiaojuan Qi

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI) 2022.
[PDF] [CODE]

DODA: Data-oriented Sim-to-Real Domain Adaptation for 3D Indoor Semantic Segmentation
Runyu Ding*, Jihan Yang*, Xiaojuan Qi

European Conference on Computer Vision (ECCV), 2022.
[PDF] [CODE]

Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigation
Ruifei He*, Jihan Yang*, Xiaojuan Qi

IEEE International Conference on Computer Vision (ICCV), 2021. [Oral]
[PDF] [CODE]

ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
Jihan Yang*, Shaoshuai Shi*, Zhe Wang, Hongsheng Li, Xiaojuan Qi

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[PDF] [CODE]

An adversarial perturbation oriented domain adaptation approach for semantic segmentation
Jihan Yang, Ruijia Xu, Ruiyu Li, Xiaojuan Qi, Xiaoyong Shen, Guanbin Li, Liang Lin

AAAI, 2020.
[PDF]

Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain Adaptation
Ruijia Xu, Guanbin Li, Jihan Yang, Liang Lin

IEEE International Conference on Computer Vision (ICCV), 2019.[Oral]
[PDF] [CODE]

Best Paper Award Nomination (one of the seven among 1,075 accepted papers) refer to here.

Experience

Courant Institute of Mathematical Sciences, NYU
April 2023 - Aug 2024

Research intern with Prof. Saining Xie
Autonomous Driving Group, SenseTime
May 2020 - Oct 2020

Research intern with Dr. Zhe Wang
Youtu Lab, Tencent
Feb 2019 - Feb 2020

Research intern with Dr. Ruiyu Li and Dr. Xiaoyong Shen
Research Group, YITU Technology
Jul 2018 - Sep 2019

Research intern

Honors & Awards

2nd place on 3D detection, 3D tracking and domain adaptation three tracks of Waymo Open Challenges	2020
Postgraduate Scholarship, HKU	2020 - 2024
Best Paper Nomination, IEEE International Conference on Computer Vision (0.2%)	2019
Excellent Graduate Award of Sun Yat-sen University (2%)	2019
Excellent Dissertations of Sun Yat-sen University (2%)	2019
First Prize Scholarship of Sun Yat-sen University (4%)	2017, 2018

Academic Services

Conference Reviewer:

CVPR: 21/22/23/24
ICCV: 21
ECCV: 22/24
NeurIPS: 23/24
ICLR: 24
IROS: 23
AAAI: 21
MM: 24

Journal Reviewer:

IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)
International Journal of Computer Vision (IJCV)

Teaching

ELEC3249 Pattern Recognition and Machine Intelligence		2022-2023
ENGG1310 Electricity and Electronics		2021-2022
ELEC3249 Pattern Recognition and Machine Intelligence		2020-2021