I am a fourth-year PhD student at Tsinghua University, advised by Prof. Chun Yuan and Li Shen . My research centers on data-efficient model reuse (i.e., learning from models ): how to transfer, compose, and extend the knowledge encoded in pretrained models while reducing reliance on task-specific data and costly training from scratch.
My approach combines empirical investigation with theoretical analysis: I identify recurring phenomena, formulate and test hypotheses, and develop principled methods informed by these insights. A central goal is to establish effective and scalable approaches to model reuse for vision models, large language models (LLMs), and multimodal large language models (MLLMs), with careful attention to data efficiency and computational cost.
π Selected Publications
My work explores data-efficient model reuse from three angles:
Model Merging
Synthetic Data
Model Inversion
01 Model Merging
View figure β
Closed-Form Spectral Regularization for Multi-Task Model Merging
Yongxian Wei , Runxi Cheng, Xingxuan Zhang, Li Shen, Chun Yuan, Peng Cui, Dacheng Tao
Preprint
Paper Code
View figure β
OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Merging
Yongxian Wei , Runxi Cheng, Weike Jin, Enneng Yang, Li Shen, Lu Hou, Sinan Du, Chun Yuan, Xiaochun Cao, Dacheng Tao
ICLR 2026
Paper Code
View figure β
Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent
Yongxian Wei , Anke Tang, Li Shen, Zixuan Hu, Chun Yuan, Xiaochun Cao
ICML 2025
Paper Code
View figure β
Whoever Started the Interference Should End It: Guiding Data-Free Model Merging via Task Vectors
Runxi Cheng*, Feng Xiong*, Yongxian Wei , Wanyun Zhu, Chun Yuan
ICML 2025
Paper Code
02 Synthetic Data
View figure β
LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence
Xingxuan Zhang, Gang Ren, β¦, Yongxian Wei (Core Contributor), β¦, Peng Cui
Technical Report
Paper Code
View figure β
Learning to Pose Problems: Reasoning-Driven and Solver-Adaptive Data Synthesis
Yongxian Wei , Yilin Zhao, Li Shen, Xinrui Chen, Runxi Cheng, Sinan Du, Hao Yu, Chun Yuan, Dian Li
Preprint
Paper Code
View figure β
Meta-Learning without Data via Unconditional Diffusion Models
Yongxian Wei , Zixuan Hu, Li Shen, Zhenyi Wang, Chun Yuan
IEEE TCSVT
Paper Code
03 Model Inversion
View figure β
Open-Vocabulary Customization from CLIP via Data-Free Knowledge Distillation
Yongxian Wei , Zixuan Hu, Li Shen, Zhenyi Wang, Chun Yuan, Dacheng Tao
ICLR 2025 (Oral )
Paper Code
View figure β
Task-Distributionally Robust Data-Free Meta-Learning
Zixuan Hu, Yongxian Wei , Li Shen, Zhenyi Wang, Baoyuan Wu, Chun Yuan, Dacheng Tao
IEEE TPAMI
Paper Code
View figure β
Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs
Zixuan Hu, Yongxian Wei , Li Shen, Chun Yuan, Dacheng Tao
CVPR 2025
Paper Code
View figure β
Task Groupings Regularization: Data-Free Meta-Learning with Heterogeneous Pre-trained Models
Yongxian Wei , Zixuan Hu, Li Shen, Zhenyi Wang, Chun Yuan, Dacheng Tao
ICML 2024
Paper Code
View figure β
Sparse Model Inversion: Efficient Inversion of Vision Transformers for Data-Free Applications
Zixuan Hu, Yongxian Wei , Li Shen, Zhenyi Wang, Chun Yuan, Dacheng Tao
ICML 2024
Paper Code
View figure β
FREE: Faster and Better Data-Free Meta-Learning
Yongxian Wei , Zixuan Hu, Zhenyi Wang, Li Shen, Chun Yuan, Dacheng Tao
CVPR 2024
Paper Code
π₯ Honors
National Scholarship for Graduate Students (for the second time), 2025.10
National Scholarship for Graduate Students (at my first year), 2024.10
Undergraduate Presidentβs Medal (Top 10 university-wide), 2022.10
National Scholarship for Undergraduate Students, 2021.10
The First Runner-Up (2/116) of ICCV LargeFineFoodAI, 2021.10
π Education
PhD student, Tsinghua University, 2023 β Present
Undergrad, Nanjing University of Science and Technology, 2019 β 2023
πΌ Academic Service
Reviewer (Conferences): ICML / ICLR / NeurIPS / CVPR / ICCV / ECCV / AAAI
Reviewer (Journals): TPAMI / TIP / TKDE