Hongsheng Li   李鴻升 Associate Professor Department of Electronic Engineering Co-affiliated to Multimedia Laboratory The Chinese University of Hong Kong Email: hsli@ee.cuhk.edu.hk Office: SHB 428, CUHK, Hong Kong S.A.R., China

  [Google Scholar]

News

• Awarded 2023 AI 2000 Most Influential Scholar Honorable Mention in Computer Vision

• 10+ papers accepted to CVPR 2023

• 5 papers accepted to NeurIPS 2022

• To serve as an Area Chair of CVPR 2023

• To serve as a Senior Committee Member (a Meta Reviewer) of AAAI 2023

• Received CUHK Young Research Award 2021-2022

• 1 paper accepted to SIGGRAPH Asia 2022

• 9 papers accepted to ECCV 2022

Education

• Ph. D., 2008 - 2012, Computer Science, Lehigh University

• M. Eng. student, 2006 - 2007, Pattern Recognition and Intelligent System, Shanghai Jiao Tong Universtiy

• B. Eng., 2002 - 2006, Automation, East China University of Science and Technology

Employment

• Associate Professor, Jul. 2022 - Present, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Huashan Scholar Chair Professor, Apr. 2020 - Present, School of Computer Science and Technology, Xidian University

• Assistant Professor, Jul. 2018 - Jun. 2022, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Research Assistant Professor, Aug. 2015 - Jun. 2018, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Postdoctoral Fellow, Feb. 2014 - Jan. 2015, Department of Electronic Engineering, The Chinese University of Hong Kong

• Associate Professor, Jan. 2013 - Jul. 2015, School of Electronic Scicence, University of Electronic Science and Technology of China

Awards & Recognitions

• 2023 AI 2000 Most Influential Scholar Honorable Mention in Computer Vision, 2023

• World's Top 2% Scientists named by Stanford University, 2022

• CUHK Young Researcher Award 2021-2022, 2022

• 2022 AI 2000 Most Influential Scholar Honorable Mention in Computer Vision, 2022

• 2020 IEEE Circuits and System Society Outstanding Young Author Award, 2020

• Winner of ActivityNet Challenge 2020 on Spatio-temporal Action Localization (AVA), 2020

• Winner of ImageNet Video Object Detection/Tracking Challenge with provided data, 2016

• Winner of ImageNet Video Object Detection Challenge with provided data, 2015

Publications

Selected Preprints

• Better Aligning Text-to-Image Models with Human Preference,
  X. Wu, K. Sun, F. Zhu, R. Zhao, H. Li.
  arXiv:2303.14420, Technical Report, 2023. [Project][Demo]
  


• LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention,
  R. Zhang, J. Han, A. Zhou, X. Hu, S. Yan, P. Lu, H. Li, P. Gao, Y. Qiao.
  arXiv:2303.16199, Technical Report, 2023. [Project][Demo]
  


• VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation,
  X. Shi, Z. Huang, W. Bian, D. Li, M. Zhang, K. C. Cheung, S. See, H. Qin, J. Dai, H. Li.
  arXiv:2303.02881, Technical Report, 2023.
  


• KBNet: Kernel Basis Network for Image Restoration,
  Y. Zhang, D. Li, X. Shi, D. He, K. Song, X. Wang, H. Qin, H. Li.
  arXiv:2303.02881, Technical Report, 2023. [Project]
  


• Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding,
  J. Liu, T. Wang, B. Liu, Q. Zhang, Y. Liu, H. Li.
  arXiv:2303.11325, Technical Report, 2023.
  



2023

• ConQueR: Query Contrast Voxel-DETR for 3D Object Detection,
  B. Zhu, Z. Wang, S. Shi, H. Xu, L. Hong, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (highlight presentation). [Project]


• FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation,
  X. Shi, Z. Huang, D. Li, M. Zhang, K. C. Cheung, S. See, H. Qin, J. Dai, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners,
  R. Zhang, X. Hu, B. Li, S. Huang, H. Deng, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shift,
  D. Li, X. Shi, Y. Zhang, X. Wang, H. Qin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]
  


• CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matching,
  X. Wu, F. Zhu, R. Zhao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders,
  R. Zhang, L. Wang, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers,
  J. Liu, X. Huang, J. Zheng, Y. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Improving Weakly Supervised Temporal Action Localization by Bridging Train-Test Gap in Pseudo Labels,
  J. Zhou, L. Huang, L. Wang, S. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• ReasonNet: End-to-End Driving with Temporal and Global Reasoning,
  H. Shao, L. Wang, R. Chen, S. Waslander, H. Li, Y. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Starting from Non-Parametric Networks for 3D Point Cloud Analysis,
  R. Zhang, L. Wang, Y. Wang, P. Gao, H. Li, J. Shi.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Adaptive Zone-aware Hierarchical Planner for Vision-Language Navigation,
  C. Gao, X. Peng, M. Yan, H. Wang, L. Wang, H. Ren, H. Li, S. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions,
  W. Wang, J. Dai, Z. Chen, Z. Huang, Z. Li, X. Zhu, X. Hu, H. Lu, L. Lu, H. Li, X. Wang, Y. Qiao.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• PATS: Patch Area Transportation with Subdivisionfor Local Feature Matching,
  J. Ni, Y. Li, Z. Huang, H. Li, H. Bao, Z. Cui, G. Zhang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks,
  H. Li, J. Zhu, X. Jiang, X. Zhu, H. Li, C. Yuan, X. Wang, Y. Qiao, X. Wang, W. Wang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• 3D Object Detection for Autonomous Driving: A Comprehensive Survey,
  J. Mao, S. Shi, X. Wang, H. Li.
  International Journal of Computer Vision (IJCV), 2023, Accepted.


• PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection,
  S. Shi, L. Jiang, J. Deng, Z. Wang, C. Guo, J. Shi, X. Wang, H. Li.
  International Journal of Computer Vision (IJCV), Vol. 131, No. 2. pp. 531-551, 2023.



2022

• NeuralMarker: A Framework for Learning General Marker Correspondence,
  Z. Huang, X. Pan, W. Pan, W. Bian, Y. Xu, K. C. Cheung, G. Zhang, H. Li.
  ACM Transactions on Graphics (SIGGRAPH Asia 2022), 2022. [Project]
  


• ConvMAE: Masked Convolution Meets Masked Autoencoders,
  P. Gao, T. Ma, H. Li, J. Dai, Y. Qiao.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields,
  K. Sun, S. Wu, Z. Huang, N. Zhang, Q. Wang, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training,
  R. Zhang, Z. Guo, P. Gao, R. Fang, B. Zhao, D. Wang, Y. Qiao, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning for Action Recognition,
  J. Pan, Z. Lin, X. Zhu, J. Shao, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  


• Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs,
  J. Zhu, X. Zhu, W. Wang, X. Wang, H. Li, X. Wang, J. Dai.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detection,
  X. Chen, S. Shi, B. Zhu, K. C. Cheung, H. Xu, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  Ranks 1st on Open Waymo 3D object detection benchmark on June 24th, 2022
  


• FlowFormer: A Transformer Architecture for Optical Flow,
  Z. Huang, X. Shi, C. Zhang, Q. Wang, K. C. Cheung, H. Qin, J. Dai, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• UniNet: Unified Architecture Search with Convolution, Transformer, and MLP,
  J. Liu, H. Li, G. Song, X. Huang, Y. Liu.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling,
  R. Zhang, R. Fang, W. Zhang, P. Gao, K. Li, J. Dai, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Towards Robust Face Recognition with Comprehensive Search,
  M. Zhang, G. Song, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2022.
  


• Frozen CLIP is an Efficient Video Learner,
  Z. Lin, S. Geng, R. Zhang, P. Gao, G. de Melo, X. Wang, J. Dai, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Learning Degradation Representations for Image Deblurring,
  D. Li, Y. Zhang, K. C. Cheung, X. Wang, H. Qin, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers,
  J. Liu, B. Liu, Y. Liu, H. Zhou, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers,
  J. Pan, A. Bulat, F. Tan, X. Zhu, L. Dudziak, H. Li, G. Tzimiropoulos, B. Martinez.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Network,
  D. Li, Y. Zhang, K. L. Law, X. Wang, H. Qin, H. Li.
  International Journal of Computer Vision (IJCV), 2022, accepted.


• Structured Domain Adaptation with Online Relation Regularization for Unsupervised Person Re-ID,
  Y. Ge, F. Zhu, D. Chen, R. Zhao, X. Wang, H. Li.
  IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022, accepted. [Project]


• Learning a Structured Latent Space for Unsupervised Point Cloud Completion,
  Y. Cai, K.-Y. Lin, C. Zhang, Q. Wang, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022 (oral presentation).


• PointCLIP: Point Cloud Understanding by CLIP,
  R. Zhang, Z. Guo, W. Zhang, K. Li, X. Miao, B. Cui, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization,
  Y. Xu, K.-Y. Lin, G. Zhang, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• IDR: Self-Supervised Image Denoising via Iterative Data Refinement,
  Y. Zhang, D. Li, K. L. Law, X. Wang, H. Qin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation,
  L. Huang, L. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks,
  X. Zhu, J. Zhu, H. Li, X. Wu, X. Wang, H. Li, X. Wang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks,
  H. Li, T. Fu, J. Dai, H. Li, G. Huang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.


• RBGNet: Ray-based Grouping for 3D Object Detection,
  H. Wang, S. Shi, Z. Yang, R. Fang, Q. Qian, H. Li, B. Schiele, L. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning,
  K. Li, Y. Wang, G. Peng, G. Song, Y. Liu, H. Li, Y. Qiao.
  International Conference on Learning Representations (ICLR) 2022. [Project]
  



2021

• DominoSearch: Find Layer-wise Fine-grained N:M Sparse Schemes from Dense Neural Networks,
  W. Sun, A. Zhou, S. Stuijk, R. Wijnhoven, A. O. Nelson, H. Li, H. Corporaal.
  Advances in Neural Information Processing Systems (NeurIPS) 2021. [Project]
  


• Container: Context Aggregation Networks,
  P. Gao, J. Lu, H. Li, R. Mottaghi, A. Aniruddha.
  Advances in Neural Information Processing Systems (NeurIPS) 2021.
  


• A Holistically-Guided Decoder for Deep Representation Learning with Applications to Semantic Segmentation and Object Detection,
  J. Liu, S. Ren, Y. Zheng, X. Wang, H. Li.
  IEEE Trans. Pattern Analysis and Machine Intelligence, 2021. Accpeted.
  


• Fast Convergence of DETR with Spatially Modulated Co-Attention,
  P. Gao, M. Zhang, X. Wang, J. Dai, H. Li.
  International Conference on Computer Vision (ICCV), 2021. [Project]
  


• LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector,
  X. Guo, S. Shi, X. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Rethinking Noise Synthesis and Modeling in Raw Denoising,
  Y. Zhang, H. Qin, X. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localization,
  L. Huang, L. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting,
  R. Liu, H. Deng, Y. Huang, X. Shi, L. Lu, W. Sun, X. Wang, J. Dai, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation,
  M. Tian, Z. Li, Z. Wan, J. Liu, S. Yi, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Progressive Correspondence Pruning by Consensus Learning,
  C. Zhao, Y. Ge, F. Zhu, R. Zhao, H. Li, M. Salzmann.
  International Conference on Computer Vision (ICCV), 2021.
  


• Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency,
  Z. Luo, Z. Cai, C. Zhou, G. Zhang, H. Zhao, S. Yi, S. Lu, H. Li, S. Zhang, Z. Liu.
  International Conference on Computer Vision (ICCV), 2021.
  


• SymReg-GAN: Symmetric Image Registration with Generative Adversarial Networks,
  Y. Zheng, X. Sui, Y. Jiang, T. Che, S. Zhang, J. Yang, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021, to appear.
  


• Inverting Generative Adversarial Renderer for Face Reconstruction,
  J. Piao, K. Sun, K.-Y. Lin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (oral presentation).
  


• DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network,
  R. Liu, Y. Ge, C. L. Choi, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification,
  X. Zhang, Y. Ge, Y. Qiao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [code]
  


• Actor-Context-Actor Relation Network for Spatio-Temporal Action Localization,
  J. Pan, S. Chen, M. Z. Shou, Y. Liu, J. Shao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Semantic Scene Completion via Integrating Instances and Scene in-the-Loop,
  Y. Cai, X. Chen, C. Zhang, K.-Y. Lin, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• VS-Net: Voting with Segmentation for Visual Localization,
  Z. Huang, H. Zhou, Y. Li, B. Yang, Y. Xu, X. Zhou, H. Bao, G. Zhang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [Project]
  


• Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation,
  X. Zhu, H. Zhou, T. Wang, F. Hong, Y. Ma, W. Li, H. Li, D. Lin.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (oral presentation).
  


• LiDAR-based Panoptic Segmentation via Dynamic Shifting Network,
  F. Hong, H. Zhou, X. Zhu, H. Li, Z. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection,
  J. Yang, S. Shi, H. Li, X. Qi.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch,
  A. Zhou, Y. Ma, J. Zhu, J. Liu, Z. Zhang, K. Yuan, W. Sun, H. Li.
  International Conference on Learning Representations (ICLR), 2021.
  


• Efficient Attention: Attention with Linear Complexities,
  Z. Zhao, M. Zhang, H. Zhao, S. Yi, H. Li.
  Winter Conference on Applications of Computer Vision (WACV), 2021.
  


• FocusNetv2: Imbalanced Large and Small Organ Segmentation with Adversarial Shape Constraint for Head and Neck CT Images,
  Y. Gao, R. Huang, Y. Yang, J. Zhang, K. Shao, C. Tao, Y. Chen, D. N. Metaxas, H. Li*, M. Chen* (*Co-corresponding authors).
  Medical Image Analysis (MedIA), Vol. 67, No. 1, pp. 101831, 2021.
  



2020

• SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks,
  Y. Xu, Z. Huang, K.-Y. Lin, X. Zhu, J. Shi, H. Bao, G. Zhang, H. Li.
  Conference on Robotic Learning (CoRL), 2020.
  


• Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID,
  Y. Ge, F. Zhu, D. Chen, R. Zhao, H. Li.
  Neural Information Processing Systems (NeurIPS), 2020. [code]
  


• Balanced Meta-Softmax for Long-Tailed Visual Recognition,
  J. Ren, C. Yu, S. Sheng, X. Ma, H. Zhao, S. Yi, H. Li.
  Neural Information Processing Systems (NeurIPS), 2020.
  


• Self-supervising Fine-grained Region Similarities for Large-scale Image Localization,
  Y. Ge, H. Wang, F. Zhu, R. Zhao, H. Li.
  European Conference on Computer Vision (ECCV), 2020 (spotlight presentation). [code]
  


• EfficientFCN: Holistically-guided Decoding for Semantic Segmentation,
  J. Liu, J. He, J. Zhang, J. Ren, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• Learning to Predict Context-adaptive Convolution for Semantic Segmentation,
  J. Liu, J. He, J. Zhang, J. Ren, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructions,
  X. Liu, Z. Lin, J. Zhang, H. Zhao, Q. H. Tran, X. Wang, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• RBF-Softmax: Learning Deep Representative Prototypes with Radial Basis Function Softmax,
  X. Zhang, R. Zhao, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2020. [code]
  


• Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation,
  X. Chen, K.-Y. Lin, J. Wang, W. Wu, C. Qian, H. Li, G. Zeng.
  European Conference on Computer Vision (ECCV), 2020.
  


• Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets,
  R. Huang, Z. Hu, S. Zhang, H. Li.
  International Conference on Medical Image Computing and Computer Assisted Interventions (MICCAI), 2020.
  


• PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection,
  S. Shi, C. Guo, L. Jiang, Z. Wang, J. Shi, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  Ranks 1st on KITTI 3D object detection benchmark on Jan. 9th, 2020
  


• StereoGAN: Bridging Synthetic-to-Real Domain Gap by Joint Optimization of Domain Translation and Stereo Matching,
  R. Liu, C. Yang, W. Sun, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• 3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior,
  X. Chen, K.-Y. Lin, C. Qian, G. Zeng, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• Robust Superpixel-Guided Attentional Adversarial Attack,
  Y. Dong, J. Han, D. Chen, J. Liu, H. Bian, Z. Ma, H. Li, W. Zhang, N. Yu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• From Points to Parts: 3D Object Detection From Point Cloud With Part-Aware and Part-Aggregation Network,
  S. Shi, Z. Wang, X. Wang, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 43, No. 8, pp. 2647-2664, 2021. [code]
  Ranks 1st on KITTI 3D object detection benchmark on July. 9th, 2019
  


• Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification,
  Y. Ge, D. Chen, H. Li
  International Conference on Learning Representations (ICLR), 2020. [code]
  


• Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimation,
  Y. Cai, B. Li, Z. Jiao, H. Li, X. Zeng, X. Wang
  AAAI Conference on Artificial Intelligence (AAAI), 2020.
  


• Person Re-identification with Deep Kronecker-Product Matching and Group-shuffling Random Walk,
  Y. Shen, H. Li, T. Xiao, S. Yi, D. Chen, X. Wang, H. Li
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 43, No. 5, pp. 1649-1665, 2021. [code]
  


• HMS-Net: Hierarchical Multi-scale Sparsity-invariant Network for Sparse Depth Completion,
  Z. Huang, J. Fan, S. Cheng, S. Yi, X. Wang, H. Li
  IEEE Transactions on Image Processing (TIP), Vol. 29, No. 12, pp. 3429-3441, 2020.
  



2019

• Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis,
  X. Liu, G. Yin, J. Shao, X. Wang, H. Li
  Annual Conference on Neural Information Processing Systems (NeurIPS), 2019.
  


• FocusNet: Imbalanced Large and Small Organ Segmentation with an End-to-End Deep Neural Network for Head and Neck CT Images,
  Y. Gao^, R. Huang^, M. Chen, Z. Wang, J. Deng, Y. Chen, Y. Yang, J. Zhang, C. Tao, H. Li (^Equal contribution)
  International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2019.
  


• Semi-supervised Monocular 3D Face Reconstruction with End-to-end Shape-preserved Domain-transfer,
  J. Piao, Q. Chen, H. Li
  International Conference on Computer Vision (ICCV), 2019 (oral presentation).
  


• Interpolated Convolutional Networks for 3D Point Cloud Understanding,
  J. Mao, X. Wang, H. Li
  International Conference on Computer Vision (ICCV), 2019 (oral presentation).
  


• Multi-modality Latent Interaction Network for Visual Question Answering,
  P. Gao, X. Wang, Z. Zhang, X. Wang, H. Li
  International Conference on Computer Vision (ICCV), 2019.
  


• Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints,
  Y. Xu, X. Zhu, J. Shi, G. Zhang, H. Bao, H. Li
  International Conference on Computer Vision (ICCV), 2019.
  


• CAMP: Cross-modal Adaptive Message Passing for Text-image Retrieval,
  Z. Wang, X. Liu, H. Li, L. Sheng, J. Yan, X. Wang, J. Shao
  International Conference on Computer Vision (ICCV), 2019.
  


• AdaCos: Adaptively Scaling Cosine Logit for Learning Deep Face Representation,
  X. Zhang, R. Zhao, Y. Qiao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (oral presentation).
  


• Dynamic Fusion with Intra- and Inter-modality Attention Flow for Visual Question Answering,
  P. Gao, H. You, Z. Jiang, P. Lu, S. Hoi, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (oral presentation).
  


• PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud,
  S. Shi, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [code]
  


• P2SGrad: Refined Gradients for Optimizing Deep Face Models,
  X. Zhang, R. Zhao, J. Yan, M. Gao, Y. Qiao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Group-wise Correlation Stereo Network,
  X. Guo, K. Yang, W. Yang, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [code]
  


• Improving Referring Expression Grounding with Cross-modal Attention-guided Erasing,
  X. Liu, Z. Wang, J. Shao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Conditional Adversarial Generative Flow for Controllable Image Synthesis,
  R. Liu, X. Gong, Y. Liu, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Signet Ring Cell Detection With a Semi-supervised Learning Framework,
  J. Li, S. Yang, X. Huang, Q. Da, X. Yang, Z. Hu, Q. Duan, C. Wang, H. Li
  International Conference on Information Processing in Medical Imaging (IPMI), 2019.
  


• Unsupervised Cross-spectral Stereo Matching by Learning to Synthesize,
  M. Liang, X. Guo, H. Li, X. Wang, Y. Song
  AAAI Conference on Artificial Intelligence (AAAI), 2019 (oral presentation).
  


• A^2-Net: Molecular Structure Estimation for Cryo-EM Density Volumes,
  K. Xu, Z. Wang, J. Shi, H. Li, Q. C. Zhang
  AAAI Conference on Artificial Intelligence (AAAI), 2019.
  



2018

• FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification,
  Y. Ge, Z. Li, H. Zhao, G. Yin, S. Yi, X. Wang, H. Li
  Annual Conference on Neural Information Processing Systems (NeurIPS), 2018. [code]
  


• StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks,
  H. Zhang^, T. Xu^, H. Li, S. Zhang, X. Wang, X. Huang, D. N. Metaxas (^co-first authors)
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 41, No. 8, pp. 1947-1962, 2019. [code]
  


• Show, Tell and Discriminate: Image Captioning by Self-retrieval with Partially Labeled Data,
  X. Liu, H. Li, J. Shao, D. Chen, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Question-Guided Hybrid Convolution for Visual Question Answering,
  P. Gao, H. Li, S. Li, P. Lu, Y. Li, S. C. H. Hoi, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Learning Monocular Depth by Distilling Cross-domain Stereo Networks,
  X. Guo, H. Li, S. Yi, J. Ren, X. Wang
  European Conference on Computer Vision (ECCV), 2018. [code]
  


• Person Re-identification with Deep Similarity-Guided Graph Neural Network,
  Y. Shen, H. Li, S. Yi, D. Chen, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Association,
  D. Chen, H. Li, X. Liu, Y. Shen, J. Shao, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Group Consistent Similarity Learning via Deep CRF for Person Re-Identification,
  D. Chen, D. Xu, H. Li, N. Sebe, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (oral presentation). [code]
  


• Video Person Re-Identification With Competitive Snippet-Similarity Aggregation and Co-Attentive Snippet Embedding,
  D. Chen, H. Li, T. Xiao, S. Yi, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Deep Group-Shuffling Random Walk for Person Re-Identification,
  Y. Shen, H. Li, T. Xiao, S. Yi, D. Chen, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [code]
  


• End-to-End Deep Kronecker-Product Matching for Person Re-Identification,
  Y. Shen^, T. Xiao^, H. Li, S. Yi, X. Wang (^co-first authors).
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [code]
  


• Eliminating Background-Bias for Robust Person Re-Identification,
  M. Tian, S. Yi, H. Li, S. Li, X. Zhang, J. Shi, J. Yan, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Single View Stereo Matching,
  Y. Luo, J. Ren, M. Lin, J. Pang, W. Sun, H. Li, L. Lin.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (spotlight presentation).
  


• 3D Human Pose Estimation in the Wild by Adversarial Learning,
  W. Yang, W. Ouyang, X. Wang, J. Ren, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Deep Continuous Conditional Random Fields with Asymmetric Inter-object Constraints for Online Multi-object Tracking,
  H. Zhou, W. Ouyang, J. Cheng, X. Wang, H. Li.
  IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), Vol. 29, No. 4, pp. 1011-1022, 2019.
  


• T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos,
  K. Kang^, H. Li^, J. Yan, X. Zeng, B. Yang, T. Xiao, C. Zhang, Z. Wang, R. Wang, X. Wang, W. Ouyang (^co-first authors).
  IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), Vol. 28, No. 10, pp. 2896-2907, 2018. [code]
  The winning method for ILSVRC 2015 VID task.


• Co-attending Free-form Regions and Detections with Multi-modal Multiplicative Feature Embedding for Visual Question Answering,
  P. Lu, H. Li, W. Zhang, J. Wang, X. Wang.
  AAAI Conference on Artificial Intelligence (AAAI), 2018. [code]

2017

• L0 Regularized Stationary Time Estimation for Crowd Analysis,
  S. Yi, X. Wang, C. Wu, J. Jia, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 39, no. 5, pp. 981-994, 2017.
  


• StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks,
  H. Zhang, T. Xu, H. Li, S. Zhang, X. Wang, X. Huang, D. Metaxas.
  International Conference on Computer Vision (ICCV), 2017 (oral presentation). [code]


• Identity-Aware Textual-Visual Matching with Latent Co-attention,
  S. Li, T. Xiao, H. Li, W. Yang, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Learning Deep Neural Networks for Vehicle Re-ID with Visual-spatio-temporal Path Proposals,
  Y. Shen, T. Xiao, H. Li, S. Yi, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Online Multi-Object Tracking Using Single Object Tracker with Spatial and Temporal Attention,
  Q. Chu, W. Ouyang, H. Li, X. Wang, N. Yu.
  International Conference on Computer Vision (ICCV), 2017.
  


• Learning Feature Pyramids for Human Pose Estimation,
  W. Yang, S. Li, W. Ouyang, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Orientation Invariant Feature Embedding and Spatial Temporal Re-ranking for Vehicle Re-identification,
  Z. Wang, L. Tang, X. Liu, Z. Yao, S. Yi, J. Shao, J. Yan, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection,
  Z. Wang, Y. Yin, J. Shi, W. Fang, H. Li, X. Wang.
  Medical Image Computing and Computer Assisted Interventions Conference (MICCAI), 2017.
  


• Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classification,
  F. Zhu, H. Li, W. Ouyang, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  


• Object Detection in Videos with Tubelet Proposal Networks,
  K. Kang, H. Li, T. Xiao, W. Ouyang, J. Yan, X. Liu, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  


• Person Search with Natural Language Description,
  S. Li, T. Xiao, H. Li, B. Zhou, D. Yue, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  

2016

• Pedestrian Behavior Modeling from Stationary Crowds with Applications to Intelligent Surveillance,
  S. Yi, H. Li, X. Wang.
  IEEE Transactions on Image Processing (TIP), vol. 25, no. 7, pp. 4354-4368, 2016.
  


• Data-Driven Crowd Understanding: A Baseline for a Large-Scale Crowd Dataset,
  C. Zhang, K. Kang, H. Li, X. Wang, R. Xie, X. Yang.
  IEEE Transactions on Multimedia (TMM), vol. 18, no. 6, pp. 1048-1061, 2016.
  


• Pedestrian Behavior Understanding and Prediction with Deep Neural Networks,
  S. Yi, H. Li, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Learnable Histogram: Statistical Context Features for Deep Neural Networks,
  Z. Wang, H. Li, W. Ouyang, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Crossing-line Crowd Counting with Two-phase Deep Neural Networks,
  Z. Zhao, H. Li, R. Zhao, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification,
  T. Xiao, H. Li, W. Ouyang, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  


• Object Detection from Video Tubelets with Convolutional Neural Networks,
  K. Kang, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (spotlight presentation).
  


• End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human Pose Estimation,
  W. Yang, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral presentation).
  


• Structured Feature Learning for Pose Estimation,
  X. Chu, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  


• Magnetic Resonance Fingerprinting with Compressed Sensing and Distance Metric Learning,
  Z. Wang, H. Li, Q. Zhang, J. Yuan, X. Wang.
  Neurocomputing, vol. 174, no. 1, pp. 560-570, 2016.
  

2015

• Pedestrian Travel Time Estimation in Crowded Scenes,
  S. Yi, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2015.
  


• Cross-Scene Crowd Counting via Deep Convolutional Neural Networks,
  C. Zhang, H. Li, X. Wang, X. Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• Understanding Pedestrian Behaviors From Stationary Crowd Groups,
  S. Yi, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• Saliency Detection by Multi-Context Deep Learning,
  R. Zhao, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• DeepID-Net: Deformable Deep Convolutional Neural Networks for Object Detection,
  W. Ouyang, X. Wang, X. Zeng, S. Qiu, P. Luo, Y. Tian, H. Li, S. Yang, Z. Wang, C.-C. Loy, X. Tang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  

2014

• Feature Matching with Affine-Function Transformation Models,
  H. Li, X. Huang, J. Huang, S. Zhang.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 36, no. 12, pp. 2407-2422, 2014.
  


• Solving a Special Type of Jigsaw Puzzles: Banknote Reconstruction From a Large Number of Fragments,
  H. Li, Y. Zheng, S. Zhang, J. Cheng.
  IEEE Transactions on Multimedia (T-MM), vol. 16, no. 2, pp. 571-578, 2014.
  


• Silhouette Analysis for Human Action Recognition Based on Maximum Spatio-Temporal Dissimilarity Embedding,
  J. Cheng, H. Liu, H. Li*. (*Corresponding Author)
  Machine Vision and Applications (MVA), vol. 25, no. 4, pp. 1007-1018, 2014.
  


• Preconditioning for Accelerated Iteratively Reweighted Least Squares in Structured Sparsity Reconstruction,
  C. Chen, J. Huang, L. He, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014 (oral presentation).
  


• Statistical Background Subtraction Based on Imbalanced Learning,
  X. Zhang, Z. Liu, H. Li, X. Zhao.
  International Conference on Multimedia and Expo (ICME), 2014.
  


• Highly Efficient Forward and Backward Propagation of Convolutional Neural Networks for Pixelwise Classification,
  H. Li, R. Zhao, X. Wang.
  arXiv:1412.4526
  

2013

• Object Matching Using a Locally Affine Invariant and Linear Programming Techniques,
  H. Li, X. Huang, L. He.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 35, no. 2, pp. 411-424, 2013.
  

2012

• Automatic Image Annotation and Retrieval Using Group Sparsity,
  S. Zhang, J. Huang, H. Li, D.N. Metaxas.
  IEEE Transactions on Systems, Man, and Cybernetics, Part B (TSMC), vol. 42, no. 3, pp. 838-849, 2012.
  


• A Hierarchical Image Clustering Cosegmentation Framework,
  E. Kim, H. Li, X. Huang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
  

2011

• Approximately Global Optimization for Robust Alignment of Generalized Shapes,
  H. Li, T. Shen, X. Huang.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 33, no. 6, pp. 1116-1131, 2011.
  


• Composite Splitting Algorithms for Convex Optimization,
  J. Huang, S. Zhang, H. Li, D.N. Metaxas.
  Computer Vision and Image Understanding (CVIU), vol. 115, no. 12, pp. 1610-1622, 2011.
  


• Optimal Object Matching via Convexification and Composition,
  H. Li, J. Huang, S. Zhang, X. Huang.
  International Conference on Computer Vision (ICCV), 2011.
  


• A 3D Laplacian-Driven Parametric Deformable Model,
  T. Shen, X. Huang, H. Li, E. Kim, S. Zhang, J. Huang.
  International Conference on Computer Vision (ICCV), 2011.
  


• Extraction and Analysis of Actin Networks Based on Open Active Contour Models,
  T Xu, H. Li, T. Shen, N. Ojkic, D. Vavylonis, X. Huang
  International Symposium on Biomedical Imaging (ISBI), 2011.
  


• Actin Filament Segmentation Using Dynamic Programming,
  H. Li, T. Shen, X. Huang.
  Information Processing in Medical Imaging (IPMI), 2011.
  

2010

• Segmentation and Tracking of Cytoskeletal Filaments Using Open Active Contours,
  M.B. Smith^, H. Li^, T. Shen^, X. Huang, E. Yusuf, D. Vavylonis. (^Co-first Authors)
  Cytoskeleton, vol. 67, no. 11, pp. 693-705, 2010.
  


• Object Matching with a Locally Affine-Invariant Constraint,
  H. Li, E. Kim, X. Huang, L. He
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
  


• Automatic Image Annotation U 節目在sing Group Sparsity,
  S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, D.N. Metaxas
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010 (oral presentation).
  


• Actin Filament Segmentation Using Spatiotemporal Active-Surface and Active-Contour Models,
  H. Li, T. Shen, D. Vavylonis, X. Huang.
  International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2010 (oral presentation).
  

2009

• Global Optimization for Alignment of Generalized Shapes,
  H. Li, T. Shen, X. Huang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
  


• Actin Filament Tracking Based on Particle Filters and Stretching Open Active Contour Models,
  H. Li, T. Shen, D. Vavylonis, X. Huang.
  International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2009.
  


• Automated Actin Filament Segmentation, Tracking and Tip Elongation Measurements Based on Open Active Contour Models,
  H. Li, T. Shen, M.B. Smith, I. Fujiwara, D. Vavylonis, X. Huang.
  International Symposium on Biomedical Imaging (ISBI), 2009 (oral presentation).
  


• Active Volume Models for 3D Medical Image Segmentation,
  T. Shen, H. Li, X. Huang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
  

Old Code

• FastFPBP: code of fast CNN for pixelwise classification (arXiv:1412.4526) based on Caffe's original implementation.

• PAMI14_ICCV11_matching_demo.zip: demo code for our T-PAMI'14 and ICCV'11 papers.

• PAMI13_CVPR10_Matching_v0.1.zip: demo code for our T-PAMI'13 and CVPR'10 papers.