Rui Tian

I obtained my Ph.D. degree from the College of Computer Science and Artificial Intelligence at Fudan University (Shanghai, China) in 2026, advised by Dr. Zuxuan Wu at the Fudan Vision & Learning Lab. Before that, I received my B.Sc. in Computer Science from Fudan University in 2021.

During my Ph.D., I interned at Apple, where I worked with Dr. Mingfei Gao and Dr. Mingze Xu. I also interned at Microsoft Research Asia under the supervision of Dr. Qi Dai.

My research focuses on multimodal AI, particularly visual agents and multimodal generation.

Publications & Preprints

* denotes equal contribution.

MintAct: A Unified Visual Agent for Digital Environments

Mingfei Gao*, Rui Tian*, Haiming Gang*, Bohan Zhai*, Le Zhang, Yuanzheng Gong, Di Feng, Ege Özsoy, Kaixin Ma, Vishwesh Kirthivasan, Oğuzhan Fatih Kar, Roman Bachmann, Anders Boesen Lindbo Larsen, Afshin Dehghan.

Preprint, 2026.

Research summary

We present MintAct, a family of vision-language models that unifies UI grounding, multi-step navigation, and visual tool use across mobile, desktop, and web environments. Scalable environments and asynchronous reinforcement learning enable generalist agents to match domain specialists, achieving a score of 48.9 on OSWorld-Verified.

UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learning

Rui Tian, Mingfei Gao, Haiming Gang, Jiasen Lu, Zhe Gan, Yinfei Yang, Zuxuan Wu, Afshin Dehghan.

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026.

Research summary

We present UniGen-1.5 for unified image understanding, generation, and editing. A shared-reward reinforcement learning strategy jointly improves generation and editing, while a lightweight Edit Instruction Alignment stage improves instruction comprehension.

UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generation [Code]

Rui Tian*, Mingfei Gao*, Mingze Xu*, Jiaming Hu, Jiasen Lu, Zuxuan Wu, Yinfei Yang, Afshin Dehghan.

Advances in Neural Information Processing Systems (NeurIPS), 2025.

Research summary

We introduce UniGen, a unified multimodal large language model for understanding and generation. Our Chain-of-Thought Verification (CoT-V) strategy allows the model to act as both an image generator and a step-by-step image quality verifier at test time.

ResFormer: Scaling ViTs with Multi-Resolution Training [Code]

Rui Tian, Zuxuan Wu, Qi Dai, Han Hu, Yu Qiao, Yu-Gang Jiang.

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

Research summary

We introduce ResFormer to improve vision transformer performance across image resolutions, including unseen resolutions. The approach combines multi-resolution training, a scale consistency loss, and adaptive global-local positional embeddings.

The Role of ViT Design and Training in Robustness to Common Corruptions

Rui Tian, Zuxuan Wu, Qi Dai, Micah Goldblum, Han Hu, Yu-Gang Jiang.

IEEE Transactions on Multimedia (TMM), 2025.

Research summary

We study how vision transformer design and training affect robustness to common corruptions, identifying architectural choices that improve robustness. We also introduce input-conditioned dynamic data augmentation.

TinyMem: Condensing Multimodal Memory for Long-Form Video Action Detection

Rui Tian, Qi Dai, Han Hu, Zuxuan Wu.

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

Research summary

We introduce TinyMem for long-form video action detection. It combines succinct textual descriptions with region-condensed visual memory to capture long-range dependencies efficiently.

Research Experience

AppleResearch Intern

Visual Agents and Multimodal Foundation Models

Supervised by Dr. Mingfei Gao and Dr. Mingze Xu

Jan. 2026 – Jun. 2026; Nov. 2024 – Nov. 2025
Microsoft Research AsiaResearch Intern

Generative AI · Scalable Vision

Supervised by Dr. Qi Dai

Apr. 2023 – Oct. 2024; Oct. 2021 – Sep. 2022

Education

Fudan University

Ph.D. in Computer Science and Artificial Intelligence

Sep. 2021 – Jun. 2026
Fudan University

B.Sc. in Computer Science (Elite Program)

Sep. 2017 – Jun. 2021

Services

Conference Reviewer: CVPR, ICCV, ICLR, ICML, NeurIPS, and AAAI.

Journal Reviewer: TMLR and TMM.

Honors & Awards