Yu Zheng
I am currently a Postdoctoral Research Fellow of Department
of Automation at Tsinghua University, affiliated with Intelligent Vision Group (IVG), supervised by
Prof. Jie Zhou.
I received the B.Eng. and Ph.D. degrees in Control Science and Engineering from Department of Automatjion, Tsinghua University, China, in 2019 and 2024, respectively, supervised by
Prof. Jiwen Lu.
My recent research interests focus on computer vision safety and 3D vision.
Email /
GitHub /
Google Scholar
|
|
News
2025-06: Two papers on visual forensics are accepted to ICCV 2025.
2025-05: One paper on 3D representation learning and neural rendering is accepted to TMM.
2025-01: One paper on multi-view 3D object detection is accepted to ICLR 2025.
2024-09: One paper on 3D recognition is accepted to TIP.
2024-06: I am honored with Excellent Doctoral Dissertation of Tsinghua University. (top 7.3%).
2023-11: One paper on 3D object detection is accepted to T-PAMI.
2023-05: One paper on semantic neural rendering is accepted to CVPR 2023.
2022-09: One paper on 3D recognition are accepted to TIP.
2022-05: Two papers on 3D object detection are accepted to CVPR 2022, one with oral presentation.
2020-07: One paper on 3D object detection is accepted to ECCV 2020.
2020-06: I am honored with the Future Scholar Scholarship of Tsinghua University. (top 5%).
2019-03: Two papers on 3D recognition and instructional video analysis are accepted to CVPR 2019.
|
(* indicates equal contribution.)
|
ShadowNeRF: Learning Neural Radiance Field with Sight Degradation and Recovery
Yu Zheng, Hongru Yan, Yueqi Duan, and Jiwen Lu
IEEE Transactions on Multimedia (TMM), 2025
[PDF]
We enhance the 3D representational ability of Neural Radiance Field through artificial sight degradation and self-supervised recovery.
|
|
Gaussian-Det: Learning Closed-Surface Gaussians for 3D Object Detection
Hongru Yan*, Yu Zheng*, and Yueqi Duan
International Conference on Learning Representations (ICLR), 2025
[PDF]
[Project]
It is the first 3D Gaussian based 3D object detector, where we address the outlier issue via closure measurement.
|
|
Structural Relation Modeling of 3D Point Clouds
Yu Zheng, Jiwen Lu, Yueqi Duan, and Jie Zhou
IEEE Transactions on Image Processing (TIP), 2024
[PDF]
[Code]
We propose a graph-based 3D point cloud recognition scheme that weighs the contribution of local geometries from an entropy perspective.
|
|
Learning Dynamic Scene-Conditioned 3D Object Detectors
Yu Zheng, Yueqi Duan, Zongtai Li, Jie Zhou, and Jiwen Lu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
[PDF]
We propose to decouple the 3D object detection task into ''what'' and ''where'' as an upstream scene prior .
|
|
Semantic-Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention
Fangfu Liu, Chubin Zhang, Yu Zheng, and Yueqi Duan
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[PDF]
[Code]
[Project]
It is the first generalizable semantic radiance field, where we tackles the undue multi-view semantic ambiguity by designing a cross-reprojection attention.
|
|
PointRas: Uncertainty-Aware Multi-Resolution Learning for Point Cloud Segmentation
Yu Zheng, Xiuwei Xu, Jie Zhou, and Jiwen Lu
IEEE Transactions on Image Processing (TIP), 2022
[PDF]
[Code]
We propose to leverage the low-noise representational ability of low-resolution point cloud to regularize the high-noise high-resolution point cloud.
|
|
HyperDet3D: Learning a Scene-conditioned 3D Object Detector
Yu Zheng,Yueqi Duan, Jiwen Lu, Jie Zhou, and Qi Tian
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[PDF]
We propose to provide scene prior for 3D objects that share geometry features but are similar in color or texture.
|
|
Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancement
Xiuwei Xu, Yifan Wang, Yu Zheng,Yongming Rao, Jie Zhou, and Jiwen Lu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[PDF]
[Code]
We propose to fully utilize the synthetic 3D assets with physics constraint to serve for real-world 3D detection with scarce supervisions.
|
|
Rotation-robust Intersection over Union for 3D Object Detection
Yu Zheng, Danyang Zhang, Sinan Xie, Jiwen Lu, and Jie Zhou
European Conference on Computer Vision (ECCV), 2020
[PDF]
[Code]
An optimizing method that tackles the loss-metric mismatch in oriented object detection, not limited to 3D scenarios.
|
|
Structural Relational Reasoning of Point Clouds
Yueqi Duan, Yu Zheng, Jiwen Lu, Jie Zhou, Qi Tian
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[PDF]
[Code]
We propose to learn the abundant geometrical and locational relations in 3D point cloud.
|
|
COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysis
Yansong Tang, Dajun Ding, Yongmign Rao, Yu Zheng, Danyang Zhang, Lili Zhao, Jiwen Lu, and Jie Zhou
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[PDF]
[Project]
[Evaluation]
[Annotations]
[Annotation Tool]
We construct by far the largest-scale (>10k) instructional video datasets with abundant annotations.
|
Honors and Awards
Excellent Doctoral Dissertation of Tsinghua University (top 7.3%), 2024.
Future Scholar Scholarship of Tsinghua University (top 5%), 2019.
|
Professional Activities
Reviewer, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
Reviewer, International Conference on Computer Vision (ICCV).
Reviewer, European Conference on Computer Vision (ECCV).
Reviewer, Annual AAAI Conference on Artificial Intelligence (AAAI).
Reviewer, IEEE International Conference on Multimedia and Expo (ICME).
Reviewer, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
Reviewer, IEEE Transactions on Image Processing (TIP).
Reviewer, IEEE Transactions on Information Forensics and Security (TIFS).
Reviewer, IEEE Transactions on Multimedia (TMM).
Reviewer, IEEE Transactions on Circuits and Systems for Video Technology (TCSVT).
|
|