Hi! I'm Weifeng LIN (林炜丰)

PhD at MMLab CUHK,
Specialized in Vision-Language-Model.

About

I am currently a second-year Ph.D. student at the MMLab, The Chinese University of Hong Kong (CUHK), supervised by Hongsheng Li. I earned both my Bachelor's and Master's degrees from South China University of Technology in 2021 and 2024, respectively, advised by Lianwen Jin.

My research interests include interactive vision-language models, large-scale generative models, Embodied AI, and World Models. I am also committed to open-source projects and believe they are a cornerstone for sustainable growth in the AI community.

Research

Selected Publications

Rethinking VLM Representation for VLA Initialization

Weifeng Lin, Siyuan Huang, Hao Li, Tingwei Chen, Ruichuan An, Xinyu Wei, Jianbo Liu, Hongsheng Li

arXiv preprint

Paper Code

Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videos

Weifeng Lin, Xinyu Wei, Ruichuan An, Tianhe Ren, Tingwei Chen, Renrui Zhang, Ziyu Guo, Wentao Zhang, Lei Zhang, Hongsheng Li

NeurIPS 2025

Paper Homepage Code Dataset

PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions

Weifeng Lin, Xinyu Wei, Renrui Zhang, Le Zhuo, Shitian Zhao, Siyuan Huang, Junlin Xie, Yu Qiao, Peng Gao, Hongsheng Li

ICLR 2025

Paper Code

Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want

Weifeng Lin, Xinyu Wei, Renrui Zhang, Ruichuan An, Peng Gao, Bocheng Zou, Yulin Luo, Siyuan Huang, Shanghang Zhang, Hongsheng Li

ICLR 2025

Paper Homepage Code

Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining

Dongyang Liu*, Shitian Zhao*, Le Zhuo*, Weifeng Lin*, Yu Qiao, Hongsheng Li, Peng Gao

IJCV 2025

Paper Code

Sphinx-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models

Dongyang Liu*, Renrui Zhang*, Longtian Qiu*, Siyuan Huang*, Weifeng Lin*, Shitian Zhao, Shijie Geng, Ziyi Lin, Peng Jin, Kaipeng Zhang, Wenqi Shao, Chao Xu, Conghui He, Junjun He, Hao Shao, Pan Lu, Hongsheng Li, Yu Qiao, Peng Gao

ICML 2024

Paper Code