avatar

Xiangxian Li 李象贤

Postdoctoral Researcher
Shandong University
xiangxianli@sdu.edu.cn

Researching multimodal intelligence, robust learning, and human-centered interaction.



About Me

I am currently a specially funded postdoctoral researcher at the School of Airspace Science and Engineering, Shandong University (SDU). I received my Ph.D. degree in Engineering from the School of Software, SDU, in June 2024, under the supervision of Prof. Xiangxu Meng, with Prof. Lei Meng as my co-advisor. Before that, I worked on intelligent recommendation algorithms for user interface elements under the supervision of Prof. Chenglei Yang, and I received my Bachelor’s degree from Huazhong University of Science and Technology (HUST) in June 2018.

My research interests lie in multimedia computing and intelligent human-computer interaction. I aim to develop intelligent systems capable of robust perception, understanding, interaction, and execution in complex and open environments. Specifically, my work focuses on multimodal robust representation learning under data-scarce and long-tailed conditions, user intention modeling in complex interactive scenarios, and embodied navigation and interaction in open environments. My research has been applied to scenarios such as in-vehicle interaction, UAV navigation, hematologic tumor early warning, dietary image analysis, and legal document inspection.

My research story centers on building multimodal systems that stay reliable when data are scarce, incomplete, or long-tailed, and that can better understand user intention in complex human-centered scenarios.

Research Highlights

Multimodal Robust Representation Learning

Learning stable representations when data are scarce, noisy, incomplete, or long-tailed, so models remain useful in realistic settings.

User Intention Modeling

Inferring user goals and behavior in complex interactive scenarios to make systems more responsive, interpretable, and human-centered.

Embodied Navigation and Interaction

Building systems that can perceive, navigate, and interact in open environments, especially when the scene and task keep changing.

Applied Multimodal Intelligence

Translating core methods into practical systems for healthcare, transportation, and document understanding.

Collaboration

I am always happy to swap ideas or start a project together in multimodal learning, human-computer interaction, and embodied intelligence, especially when the problem is messy, real, and a little fun to untangle.

News

Selected Publications

Choose a lens to show only the papers that match it.

  1. ACM MM
    Multimodal HCI
    Lewen Mi, Manyi Li, Yuling Sun, Yufan Zhang, Yuxin Shi, Yulong Bian, Xiangxian Li, Juan Liu
    ACM International Conference on Multimedia, 2026
    What we do
    Uses a benchmark plus iterative reasoning so the system can inspect child-oriented videos and explain why a clip may be risky.

  2. EMNLP
    Multimodal Robust
    Yongju Jia, Jiarui Ma, Xiangxian Li*, Baiqiao Zhang, Xianhui Cao, Juan Liu, Yulong Bian (*Corresponding author)
    Conference on Empirical Methods in Natural Language Processing, 2025
    What we do
    Learns when to send a prompt to different expert branches, so vision-language tuning stays balanced when long-tailed examples are rare.

  3. EMNLP
    HCI
    Baiqiao Zhang, Zhifeng Liao, Xiangxian Li*, Chao Zhou, Juan Liu, Xiaojuan Ma*, Yulong Bian*
    Conference on Empirical Methods in Natural Language Processing, 2025
    What we do
    Shows that a shorter dialogue can still capture enough behavioral signal for personality assessment, without making the conversation drag on.

  4. ACM MM
    Multimodal HCI
    Xiangxian Li, Yawen Zheng*, Baiqiao Zhang, Yijia Ma, XianhuiCao, Juan Liu, Yulong Bian, Jin Huang, Chenglei Yang
    ACM International Conference on Multimedia, 2025
    What we do
    Tracks what users are likely trying to select when the target keeps moving, which is useful for dynamic interaction scenes.

  5. JSCI
    Multimodal Robust
    Xiangyu Meng, Xiangxian Li*, Lin Zhao, Yajuan Shen, Hui Sun, Xiaoming Cong, Xianhui Cao, Yunfeng Bi, Juan Liu, Yulong Bian
    Journal of King Saud University Computer and Information Sciences, 2025
    What we do
    Rebuilds missing table information by borrowing signals across modalities and reducing the bias that incomplete columns usually introduce.

  6. UIST
    Multimodal HCI
    Shilong Liu#, Chaorui Tong#, Zelu Liu, Xiangxian Li*, Yawen Zheng, Chao Zhou, Juan Liu, Yulong Bian* (#Equal contribution)
    ACM Symposium on User Interface Software and Technology, 2025.
    What we do
    Turns EEG patterns into a simple estimate of when people are entering or leaving flow during interactive tasks.

  7. AAAI
    Multimodal
    Lei Meng, Xiangxian Li, Xiaoshuo Yan*, Haokai Ma, Zhuang Qi, Wei Wu, Xiangxu Meng
    Proceedings of the AAAI Conference on Artificial Intelligence, 2025.
    What we do
    Learns causal links between aligned visual and semantic features so the classifier relies less on spurious correlations.

  8. EPJ Data Science
    Robust
    Ting Li, Lewen Mi, Xiangyu Meng, Yongju Jia, Lin Zhao, Qi Zhao, Zihao Wei, Guandong Gao, Xiangxian Li*
    EPJ Data Science, 2025.
    What we do
    Balances learning across common and rare legal motives so long-tailed text classification is less biased.

  9. UbiComp/IMWUT
    Multimodal HCI
    Baiqiao Zhang, Xiangxian Li, Yunfan Zhou, Juan Liu, Weiying Liu, Chao Zhou, Yulong Bian*
    ACM international joint conference on Pervasive and Ubiquitous Computing/ Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2024.
    What we do
    Looks for shared flow moments across participants from EEG in ubiquitous-computing settings.

  10. CVM
    Multimodal Robust
    Xiangxian Li, Yuze Zheng, Haokai Ma, Zhuang Qi, Xiangxu Meng, Lei Meng*
    Computational Visual Media, 2024.
    What we do
    Uses privileged cross-modal hints during training to learn stronger image features for long-tailed classification.

  11. JOS
    Multimodal
    Xiangxian Li, Yuze Zheng, Haokai Ma, Zhuang Qi, Xiaoshuo Yan, Xiangxu Meng, Lei Meng*
    Journal of Software (软件学报), 2024.
    What we do
    Uses extra cross-modal information during training to guide image features toward harder classes.

  12. CGI'22
    HCI
    Hao Liu#, Xiangxian Li#, Wei Gai*, Yu Huang, Jingbo Zhou, Chenglei Yang (#Equal contribution)
    Computer Graphics International Conference, 2022.
    What we do
    Predicts which interface elements each person is likely to prefer, enabling more personalized UI recommendations.

  13. ADVM'21
    Robust
    Xiangxian Li, Haokai Ma, Lei Meng*, Xiangxu Meng
    Proceedings of the 1st International Workshop on Adversarial Learning for Multimedia, 2021.
    What we do
    Compares adversarial training choices for long-tailed recognition and identifies the ones that stay stable in practice.

Awards

  • [2026] China National Collegiate Software Innovation Competition: National Second Prize, National Third Prize
  • [2023] China College Students' Service Outsourcing Innovation and Entrepreneurship Competition: National Second Prize in Track B
  • [2022] NICO CHALLENGE (ECCV Workshop): Jury Award in the Mixed-Context Generalization Track
  • [2021] ACM MM Watch and Buy: Multimodal Product Identification Challenge: Finals (7/587)
  • [2021] Shandong Provincial College Student Big Data and Intelligence Competition: First Prize (1/88)

Students

I have had the pleasure of working with several master's and undergraduate students, either independently or in collaboration with colleagues.

Master Students

  • Yongju Jia (since Sep. 2024, co-advised): Long-tailed Classification, Visual-Language Models
  • Anran Lu (since Mar. 2026, co-advised): Incomplete Data Representation

Graduated Students

  • Baiqiao Zhang (since Jul. 2023): Human-computer Interaction and Natural Language Processing. PhD Student at the Hong Kong University of Science and Technology (HKUST)
  • Xiangyu Meng (since Sep. 2024): Cross-modal Learning, Missing Modality Reconstruction. Master Student at University of Electronic Science and Technology of China (UESTC)
  • Jiarui Ma (since Nov. 2024): Long-tailed Classification, Visual-Language Models
  • Yijia Ma (since May 2025): Multimodal Computing. Now a master's student at the University of Hong Kong (HKU)
  • Qing Liu (since Sep. 2025): Human-Machine Conversation and Turn-taking.

Undergraduates

  • Lin Zhao (since Mar. 2025): Embodied UAV, Visual-Language Navigation
  • Qing Liu (since Aug. 2025): Medical Image Analysis

Powered by Jekyll and Minimal Light theme.