Xiangyue Liu

I'm a second-year Ph.D. student at HKUST advised by Prof. Ping Tan. Before that, I was a visiting student (RA) at Tsinghua University advised by Prof. Li Yi and Prof. Yang Gao. I am a member of AnySyn3D, a research interest group focusing on various topics related to 3D. My research mainly concentrates on 3D vision and graphics. I currently work on reconstruction, generation, and editing of digital avatars. Early interests include visual SLAM and MVS.

Google Scholar  ·  Github  ·  Twitter  ·  Email  ·  WeChat

πŸ”₯ News

  • 2024.11: πŸŽ‰πŸŽ‰ One paper accepted to 3DV 2025.
  • 2024.02: πŸŽ‰πŸŽ‰ One paper accepted to CVPR 2024.
  • 2023.09: πŸŽ‰πŸŽ‰ I start pursuing my Ph.D. degree at HKUST.
πŸ“‘ Publications
GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor
Xiangyue Liu, Kunming Luo, Heng Li, Qi Zhang, Yuan Liu, Li Yi, Ping Tan
3DV 2025 

We introduce GaussianAvatar-Editor, an innovative framework for text-driven editing of animatable Gaussian head avatars that can be fully controlled in expression, pose, and viewpoint.

GenN2N: Generative NeRF2NeRF Translation
Xiangyue Liu, Han Xue, Kunming Luo, Ping Tan, Li Yi
CVPR 2024  [Paper]  [Project Page]  [Code]

We present GenN2N, a unified NeRF-to-NeRF translation framework for various NeRF translation tasks such as text-driven NeRF editing, colorization, super-resolution, inpainting, etc. GenN2N achieves all these NeRF editing tasks by employing a plug-and-play image-to-image translator to perform editing in the 2D domain and lifting 2D edits into the 3D NeRF space.

Uni3D: Single Video-based Dynamic 3D Modeling for Humans and Animals with a Unified Template
Xiangyue Liu, Weixin Xu, Shuchang Zhou, Li Yi, Yang Gao
Under review
Project

PontTuset Sobolev Training for Implicit Neural Representations with Approximated Image Derivatives
Wentao Yuan, Qingtian Zhu, Xiangyue Liu, Yikang Ding, Haotian Zhang, Chi Zhang
ECCV 2022  [Paper]  [Code]

We propose a training paradigm for Implicit Neural Representations (INRs) that encode image derivatives in addition to image values in the neural network.

PontTuset KD-MVS: Knowledge Distillation Based Self-supervised Learning for Multi-view Stereo
Yikang Ding, Qingtian Zhu, Xiangyue Liu, Wentao Yuan, Haotian Zhang, Chi Zhang
ECCV 2022  [Paper]  [Code]

We propose a novel self-supervised training pipeline for MVS based on knowledge distillation, termed KD-MVS, which mainly consists of self-supervised teacher training and distillation-based student training.

PontTuset TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers
Yikang Ding*, Wentao Yuan*, Qingtian Zhu, Haotian Zhang, Xiangyue Liu, Yuanjiang Wang, Xiao Liu
CVPR 2022  [Paper]  [Code]

We analogize MVS back to its nature of a feature matching task and therefore propose a powerful Feature Matching Transformer to leverage self- and cross- attention to aggregate long-range context information within and across images.

PontTuset Structure Reconstruction Using Ray-Point-Ray Features: Representation and Camera Pose Estimation
Yijia He*, Xiangyue Liu*, Xiao Liu, Ji Zhao
ICRA 2021  [Paper]

Straight line features have been increasingly utilized in visual SLAM and 3D reconstruction systems. The straight lines’ parameterization, parallel constraint, and coplanar constraint are studied in many recent works. In this paper, we explore the novel intersection constraint of straight lines for structure reconstruction.

πŸ˜‹ Cooking

  • I love sharing food with loved ones. Check out what I cooked here.
  • I love exploring coffee shops. Check out those healing moments here.

πŸ† Awards

  • 2021.06: Excellent Graduate in Beijing
  • 2020.08: 2nd in IJCAI 3D AI Challenge: Instance Segmentation (2/559) website
  • 2016.10: National College Students Innovation and Entrepreneurship Training Program

πŸŽ“ Educations

  • 2023.09 - future: Ph.D. in Electronic and Computer Engineering, Hong Kong University of Science and Technology
  • 2018.09 - 2021.06: M.Sc. in Software Engineering, Beihang University
  • 2014.09 - 2018.06: B.Eng. in Software Engineering, Northeast Normal University

πŸ‘©πŸ»β€πŸ’» Internships

  • 2023.09 - Present: Tencent, AI Lab, supervised by Dr. Qi Zhang, and Dr. Yuxin Wen.
  • 2021.08 - 2023.08: Tsinghua University, IIIS, supervised by Prof. Li Yi, and Prof. Yang Gao
  • 2022.04 - 2023.08: MEGVII Research, AIC, supervised by Weixin Xu, Yi Yang, and Dr. Shuchang Zhou
  • 2021.06 - 2022.04: MEGVII Research, 3D Vision, supervised by Haotian Zhang, and Xiao Liu
  • 2019.08 - 2020.04: MEGVII Research, SLAM&AR, supervised by Dr. Yijia He, and Xiao Liu

Last updated: 12th Nov., 2024