Xiangyue Liu

PhD Candidate

Hong Kong University of Science and Technology
Department of ECE
Email: xliufz [at] connect [dot] ust [dot] hk

Biography

I'm a third-year PhD candidate of ECE at HKUST, under the supervision of Prof. Ping Tan. I was an RA at Tsinghua University advised by Prof. Li Yi and Prof. Yang Gao.

My research interests focus on Multimodal Pretraining, Large Multimodal Foundation Models, Unified Understanding and Generation, and Generative Models.

News

[07/2026] 🔥🔥 We open-source Rosetta, the native multimodal pretraining without catastrophic forgetting! Training example: ~90 mins on 8x or 1x H20 GPUs.⚡️
[06/2026] 🎉🎉 Our paper Symbiotic-MoE, the native multimodal pretraining with cross-modal synergy, has been accepted to ECCV 2026! See you in Sweden this Sept! 🇸🇪
[10/2025] We organized the IROS 2025 workshop on Advancements for Intelligent Robotics in 4D Scenes.
[11/2024] One paper accepted to 3DV 2025.
[02/2024] One paper accepted to CVPR 2024.
[09/2023] I started pursuing my Ph.D. degree at HKUST.

Selected Publications

	Rosetta: Composable Native Multimodal Pretraining Xiangyue Liu, Zijian Zhang, Miles Yang, Zhao Zhong, Liefeng Bo, Ping Tan [arxiv] [project page] [huggingface] [github]
	Symbiotic-MoE: Unlocking the Synergy between Generation and Understanding Xiangyue Liu, Zijian Zhang, Miles Yang, Zhao Zhong, Liefeng Bo, Ping Tan ECCV 2026 [arxiv]
	NoiseAR: AutoRegressing Initial Noise Prior for Diffusion Models Zeming Li, Xiangyue Liu, Xiangyu Zhang, Ping Tan, Heung-Yeung Shum [arxiv] [github]
	GaussianAvatar-Editor: Photorealistic Animatable Gaussian Head Avatar Editor Xiangyue Liu, Kunming Luo, Heng Li, Qi Zhang, Yuan Liu, Li Yi, Ping Tan 3DV 2025(Accept without Rebuttal) [paper] [project page] [github]
	GenN2N: Generative NeRF2NeRF Translation Xiangyue Liu, Han Xue, Kunming Luo, Ping Tan, Li Yi CVPR 2024(Reviews: 5,5,4 - Strong Accept 5) [paper] [project page] [report] [github]

Research Experience

Tencent Hunyuan Foundation Model Team

Topic: Multimodal Pretraining & Architecture Design

Nov. 2025 - Jun. 2026. Mentors: Dr. Zijian Zhang and Dr. Miles Yang

Tencent AI Lab

Topic: Digital Avatar

Sept.2023 - Dec.2024, Tencent AI Lab, worked with Dr. Yuxin Wen and Dr. Qi Zhang

Megvii Research

Topic: NeRF, Monocular Video Reconstruction

Apr.2022 - Aug.2023, AIC, worked with Weixin Xu, Yi Yang, and Dr. Shuchang Zhou

Topic: Deep MVS

Jul.2021 - Apr.2022, 3D Vision, worked with Haotian Zhang and Xiao Liu

Topic: Visual SLAM

Aug.2019 - Apr.2020, SLAM&AR, worked with Dr. Yijia He and Xiao Liu

Education & Visiting Scholar

	Hong Kong University of Science and Technology Ph.D. Candidate in ECE Advisor: Prof. Ping Tan Sep. 2023 - Present
	Tsinghua University Research Assistant in IIIS Advisors: Prof. Li Yi and Prof. Yang Gao Aug. 2021 - Aug. 2023
	Beihang University M.S. in Software Engineering Sep. 2018 - Jun. 2021
	Northeast Normal University B.E. in Software Engineering Sep. 2014 - Jun. 2018

Honors & Awards

[06/2021] Outstanding Graduate Student of Beijing.

[08/2020] Top 0.3% in 3D Instance Segmentation Challenge at IJCAI 2020. (Rank 2 out of 559)

[10/2016] National College Students Innovation and Entrepreneurship Training Program.

Teaching Assistant

[2025-2026] Electronic and Information Technology (HKUST, ELEC1010)

[2024-2025] Computer Communication Networks (HKUST, ELEC3120)

[2023-2024] Electronic and Information Technology (HKUST, ELEC1010)

Professional Service

Conference Workshop Organizer: IROS

Journal Reviewer: TPAMI

Conference Reviewer: ICCV, ECCV, ICRA, 3DV, ICLR, NeurIPS