Yuntao Du

杜云涛

Associate Researcher

Joint SDU-NTU Centre for Artificial Intelligence Research & School of Software
Shandong University
Jinan, China

Email: [email protected]

About

Currently, I am working as an Associate Researcher in the Joint SDU-NTU Centre for Artificial Intelligence Research at Shandong University. Before that, I was a research scientist at the Beijing Institute for General Artificial Intelligence (BIGAI) from 2023~2025. I got a Ph.D degree from Nanjing University in June 2023. I was a member of IIP Group, led by a professor Chongjun Wang. Before that, I received my B.Sc. degree from Northeastern University in June 2018.

I have published more than thirty papers in top conferences and journals, including ICML, NeurIPS, ICLR, CVPR, ECCV, and TMLR. Google Scholar's total citation number is 1100, and one paper is selected as "paper digest most influential papers" in CIKM 2021.

I am working on multimodal understanding, reasoning, and new knowledge learning. In particular, I'm interested in building models/agents that can generalize well and learn continously in various reasoning and multimodal tasks. Some of my research topic could be found below:

Large language model: RAG, Knowledge and reasoning
Large multimodal model: Efficient training and inference, knowledge editing, model evaluation
LLM Agent: Multi-agent system; Agent Applications
Transfer Learning & Weakly supervised learning : domain adaptation, test-time adaptation, semi-supervised learning, noisy-label learning

I am looking for self-motivated students. If interested, you are welcome to contact me.

I am open to collaborating with the field of academia and industry. If interested, you are welcome to contact me.

News

2025.11 Three paper got accepted by AAAI 2026, including two orals
2025.09 One paper got accepted by NeurIPS 2025 as Spotlight
2025.09 I will serve as Area Chair in ICLR 2025
2025.08 One paper got accepted by EMNLP 2025 Findings
2025.05 One paper got accepted by ICML 2025
2025.03 One paper got accepted by Neural Networks
2025.02 I have joined Shandong University as an Associate Researcher in C-FAIR.
2025.01 One paper got accepted by ICLR 2025
2024.12 One paper got accepted by AAAI 2025
2024.11 One paper got accepted by Neurocomputing 2024
2024.09 One paper got accepted by NeurIPS 2024
2024.08 One paper got accepted by Neural Network
2024.07 One paper got accepted by ECCV 2024
2024.03 One paper got accepted by CVPR 2024
2023.10 One paper got accepted by Machine Learning Journal
2023.03 One paper got accepted by Transactions on Machine Learning Research (TMLR)

Preprint

MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Models [PDF]
Kailin Jiang, Yuntao Du*📧, Ning Jiang, Yuchen Ren, Yuchen Li, Yifan Gao, Jinhe Bi, Yunpu Ma, Qingqing Liu, Xianhao Wang, Yifan Jia, Hongbo Jiang, Yaocong Hu, Bin Li, Lei Liu
KORE: Enhancing Knowledge Injection for Large Multimodal Models via Knowledge-Oriented Augmentations and Constraints [PDF]
Kailin Jiang, Hongbo Jiang, Ning Jiang, Zhi Gao, Jinhe Bi, Yuchen Ren, Bin Li, Yuntao Du, Lei Liu, Qing Li
Can Visual Input Be Compressed? A Visual Token Compression Benchmark for Large Multimodal Models [PDF]
Tianfan Peng*, Yuntao Du*📧, Pengzhou Ji, Shijie Dong, Kailin Jiang, Mingchuan Ma, Yijun Tian, Jinhe Bi, Qian Li, Wei Du, Feng Xiao, Lizhen Cui
When Large Multimodal Models Confront Evolving Knowledge:Challenges and Pathways [PDF]
Kailin Jiang*, Yuntao Du*, Yukai Ding, Yuchen Ren, Ning Jiang, Zhi Gao, Zilong Zheng, Lei Liu, Bin Li, Qing Li
MV-Debate: Multi-view Agent Debate with Dynamic Reflection Gating for Multimodal Harmful Content Detection in Social Media [PDF]
Rui Lu, Jinhe Bi, Yunpu Ma, Feng Xiao, Yuntao Du📧, Yijun Tian📧
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark [PDF]

Yi Xin, Jianjiang Yang, Siqi Luo, Yuntao Du, Qi Qin, Kangrui Cen, Yangfan He, Bin Fu, Xiaokang Yang, Guangtao Zhai, Ming-Hsuan Yang, Xiaohong Liu

Selected Publications

[Google Scholar]

Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models. [PDF]
Yifan Jia*, Yuntao Du*📧, Kailin Jiang*, Yuyang Liang, Qihan Ren, Yi Xin, Rui Yang, Fenze Feng, Mingcai Chen, Hengyang Lu, Haozhe Wang, Xiaoye Qu, Dongrui Liu.

AAAI 2026 (Orals, CCF A)
GitTaskBench: A Benchmark for Code Agents Solving Real-World Tasks Through Code Repository Leveraging [PDF]
Ziyi Ni, Huacan Wang, Shuo Zhang, Shuo Lu, Ziyang He, Wang You, Zhenheng Tang, Bill Sun, Hongzhang Liu, Sen Hu, Ronghao Chen, Bo Li, Xin Li, Chen Hu, Binxing Jiao, Daxin Jiang, Yuntao Du📧, Pin Lyu📧

AAAI 2026 (Orals, CCF A)
RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solving. [PDF]

Huacan Wang, Ziyi Ni, Shuo Zhang, Shuo Lu, Sen Hu, Ziyang He, Chen Hu, Jiaye Lin, Yifu Guo, Yuntao Du📧, Pin Ly📧

NeurIPS 2025 (Spotlight, CCF A)
Learning SQL Like a Human: Structure-Aware Curriculum Learning for Text-to-SQL Generation. [PDF]
Xiaohu Zhu, Qian Li, Lizhen Cui, Yuntao Du

EMNLP 2025 (Findings, CCF B)
Test-Time Selective Adaptation for Uni-Modal Distribution Shift in Multi-Modal Data. [PDF]
MingCai Chen, Baoming Zhang, Zongbo Han, Wenyu Jiang, Yanmeng Wang, Shuai Feng, Yuntao Du📧, Bingkun BAO📧

ICML 2025 (CCF A, Equal Corresponding Author)
MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge. [PDF] [WebPage]
Yuntao Du, Kailin Jiang, Zhi Gao, Chenrui Shi, Zilong Zheng, Siyuan Qi, Qing Li

ICLR 2025 (清华A类)
Robust Logit Adjustment for Learning with Long-Tailed Noisy Data. [PDF]
MingCai Chen, Yuntao Du, Wenyu Jiang, Baoming Zhang, Shuai Feng, Yi Xin, Chongjun Wang

AAAI 2025 (CCF A)
V-PETL Bench: A Unified Visual Parameter-Efficient Transfer Learning Benchmark. [PDF] [WebPage]
Yi Xin*, Siqi Luo*, Xuyang Liu*, Yuntao Du*, Haodi Zhou, Xinyu Cheng, Christina Luoluo Lee, Junlong Du, Haozhe Wang, MingCai Chen, Ting Liu, Guimin Hu, Zhongwei Wan, Rongchao Zhang, Aoxue Li, Mingyang Yi, Xiaohong Liu

NeurIPS 2024 (CCF A, Equal first author)
VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding. [PDF] [WebPage] [机器之心中文报道]
Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li

ECCV 2024 (CCF B)
Multi-source Fully Test-Time Adaptation. [PDF]

Yuntao Du, Siqi Luo, Yi Xin, MingCai Chen, Shuai Feng, Mujie Zhang, Chongjun Wang

Neural Network 2024 (JCR Q1, CCF B)
CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update. [PDF] [WebPage]
Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

CVPR 2024 (CCF A)
Generation, augmentation, and alignment: A pseudo-source domain based method for source-free domain adaptation [PDF]

Yuntao Du, Haiyang Yang, Mingcai Chen, Juan Jiang, Hongtao Luo, and Chongjun Wang.

Machine Learning (MLJ) 2023 (JCR Q1, CCF B)
DSCR: Dual View based Symmetric Consistency Regularization for Semi-Supervised Domain Adaptation [PDF]

Yuntao Du, Juan Jiang, Hongtao Luo, Haiyang Yang, Mingcai Chen, and Chongjun Wang.

Transactions on Machine Learning Research (TMLR) 2023
Two Wrongs Don’t Make a Right: Combating Confirmation Bias in Learning with Label Noise [PDF]

Mingcai Chen, Hao Cheng, Yuntao Du , Ming Xu, Wenyu Jiang, Chongjun Wang

AAAI 2023 (CCF A)
InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation [PDF]

Yuntao Du*, Hongtao Luo*, Haiyang Yang, Juan Jiang, and Chongjun Wang

ECML-PKDD 2022 (CCF B)
Semi-Supervised Learning with Multi-Head Co-Training [PDF] [Code]

Mingcai Chen, Yuntao Du , Yi zhang, Shuwei Qian, and Chongjun Wang

AAAI 2022 (CCF A)
AdaRNN: Adaptive Learning and Forecasting of Time Series [PDF] [Code] (引用超300, Rank 4th in CIKM 2021)

Yuntao Du , Jindong Wang, Wenjie Feng, Sinno Pan, Tao Qin, Renjun Xu and Chongjun Wang

CIKM 2021 (CCF B)
Adversarial Separation Network for Cross-Network Node Classification [PDF] [Code]

Xiaowen Zhang *, Yuntao Du *, Rongbiao Xie and Chongjun Wang

CIKM 2021 (CCF B, Euqal first author)
Homogeneous Online Transfer Learning with Online Distribution Discrepancy Minimization [PDF] [Code]

Yuntao Du, Zhiwen Tan, Qian Chen, Yi Zhang, Chongjun Wang.

ECAI 2020 (CCF B)

Honors & Awards

Outstanding Undergraduate Student Award, from NJU, China, May 2023

Student travel grant, CIKM 2021

First class scholarship of Yingcai, from NJU, October 2019,2020,2021,2022

Outstanding Undergraduate Student Award, from NEU, China, May 2018

Meritorious Winner, in MCM/ICM 2017, March 2017

Work Experience

[05/2020 - 10/2020] Research Intern, Machine Learning Group, MSRA

Professional Activities

Journal Reviewer
IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
Transactions on Machine Learning Research (TMLR)
Knowledge-Based Systems

Conference Reviewer

The Conference on Neural Information Processing Systems (NeurIPS) 2024

International Conference on Learning Representations (ICLR) 2024

IEEE International Conference on Computer Vision (ICCV) 2023, 2021

European Conference on Computer Vision (ECCV) 2024, 2022

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022, 2023

AAAI Conference on Artificial Intelligence (AAAI) 2022, 2023, 2024

ACM International Conference on Multimedia (ACM MM) 2021, 2023