I am a PhD student in Computer Science at The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen). I work closely with Prof. Tianshu Yu and Prof. Xiaoying Tang. My primary research interests include multimodal machine learning, Omni LLMs, and affective computing. I welcome academic collaboration. Please feel free to get in touch!

🔥 News

• 2026.09MEME has been accepted at NeurIPS 2026.
• 2026.07CoxFormer has been accepted by Nature Communications.
• 2025.09One paper accepted at NeurIPS 2025.
• 2024.11One paper accepted by IJCV.
• 2024.09One paper accepted at NeurIPS 2024.

📝 Publications

^* Equal Contribution · ^† Corresponding author

Selected Publications

Nature Communications

CoxFormer Enables Spatial Omics Inference with Multimodal Generative Modeling

Yiyang Yang^*, Xu Liao^*, Haoyu Zhang^*, Yida Wu, Xiaobo Sun, Yao Wang, Tianshu Yu, Jin Liu

Nature Communications, 2026

Code Citations

NeurIPS 2025

Improving Task-Specific Multimodal Sentiment Analysis with General MLLMs via Prompting

Haoyu Zhang, Yinan Zhang, Chaolong Ying, Xiaoying Tang, Tianshu Yu

NeurIPS, 2025

Code Citations

NeurIPS 2024

Towards Robust Multimodal Sentiment Analysis with Incomplete Data

Haoyu Zhang, Wenbin Wang, Tianshu Yu

NeurIPS, 2024

Code Citations

EMNLP 2023

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

Haoyu Zhang, Yu Wang, Guanghao Yin, Kejun Liu, Yuanyuan Liu, Tianshu Yu

EMNLP, 2023

Code Citations

Preprints

• Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue

  Chengqian Ma, Wei Tao, Haoyu Zhang, Yiwen Guo

  arXiv preprint, 2026

  Project Code Citations
• Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence

  Haoyu Zhang, Zhipeng Li, Xiaoying Tang, Tianshu Yu, Yiwen Guo

  arXiv preprint, 2026

  Project Code Citations
• Ex-Omni: Enabling 3D Facial Animation Generation for Omni-modal Large Language Models

  Haoyu Zhang, Zhipeng Li, Yiwen Guo, Tianshu Yu

  arXiv preprint, 2026

  Project Code Citations
• A Hierarchical Destroy and Repair Approach for Solving Very Large-Scale Travelling Salesman Problem

  Zhang-Hua Fu, Sipeng Sun, Jintong Ren, Tianshu Yu, Haoyu Zhang, Yuanyuan Liu, Lingxiao Huang, Xiang Yan, Pinyan Lu

  arXiv preprint, 2023

  Citations

2026

• MEME: Lightweight Hierarchical Mixture-of-Experts for Unified Affective Computing

  Yinan Zhang, Haoyu Zhang, Tianshu Yu

  NeurIPS, 2026 · Accepted

  Citations

2024

• Noise-Resistant Multimodal Transformer for Emotion Recognition

  Yuanyuan Liu, Haoyu Zhang^†, Yibing Zhan, Zijing Chen, Guanghao Yin, Lin Wei, Zhe Chen

  International Journal of Computer Vision (IJCV), 2024

  Citations
• Token-disentangling mutual Transformer for Multimodal Emotion Recognition

  Guanghao Yin, Yuanyuan Liu, Tengfei Liu, Haoyu Zhang, Ning Zhou, Fang Fang, Chang Tang, Xiaoliang Jiang

  Engineering Applications of Artificial Intelligence, 2024

  Code Citations
• Multi domain Dynamic Mean Teacher for Object Detection in Complex Weather

  Yuanyuan Liu, Chaofan Wang, Wenbin Wang, Haoyu Zhang, Zhongwen Luo

  Journal of Computer-Aided Design & Computer Graphics, 2024

  Citations

2023

• Expression Snippet Transformer for Robust Video-based Facial Expression Recognition

  Yuanyuan Liu, Wenbin Wang, Chuanxu Feng, Haoyu Zhang, Zhe Chen, Yibing Zhan

  Pattern Recognition, 2023

  Code Citations

📖 Service

Journal Reviewing

• International Journal of Computer Vision (IJCV)
• IEEE Transactions on Image Processing (TIP)
• IEEE Transactions on Multimedia (TMM)
• IEEE Transactions on Audio, Speech, and Language Processing (TASLP)
• IEEE Transactions on Mobile Computing (TMC)
• Engineering Applications of Artificial Intelligence (EAAI)
• Expert Systems with Applications (ESWA)

Conference Reviewing

• Conference on Neural Information Processing Systems (NeurIPS)
• International Conference on Learning Representations (ICLR)
• International Conference on Machine Learning (ICML)
• AAAI Conference on Artificial Intelligence (AAAI)
• ACL Rolling Review (ACL ARR)

Teaching Assistant

• CSC3100 · Data StructuresSpring 2026 · Fall 2026
• CSC1001 · Introduction to Programming LanguagesFall 2025

💻 Internships

• LightSpeed Studios, TencentApr 2025 – Present

  Project UP (青云计划) · China

• MILM Plus, XiaomiJun 2024 – Sep 2024

  China

• Shenzhen Institute of Artificial Intelligence and Robotics for SocietySep 2021 – Oct 2022

  China

🎖 Honors and Awards

• DYP Travel Award, CUHK-Shenzhen, 2025
• Scholar Award, NeurIPS 2024