Research
My current research focuses on Multimodal Generation and Understanding , with a particular interest in language, video, image generation and multimodal agent memory . Previously, I explored Optimal Transport theory for Unsupervised Deep Clustering and 3D Semi-Supervised Learning , with a focus on imbalanced and open-world scenarios.
Generally speaking, my research aim is advancing intelligent systems that can simulate, understand, and interact with the world while efficiently leveraging prior knowledge to generalize across diverse real-world scenarios. - How far are we from the genuine advent of Artificial General Intelligence?
I am open to collaboration and discussion. If you are interested, don't hesitate to reach out!
Publications
Note: * indicates equal contribution.
Hierarchical Continuous Diffusion Language Models
Hui Ren ,
Zihan Li ,
Chang Liu ,
Huidong Liu ,
Alexander Schwing
Under Review
Paper
/
Website
/
Code
Beyond the Timeline: Augmenting Long-Video Memory with Grounded Entity Biographies
Hui Ren ,
Lei Fan ,
Henry Pao ,
Han Guo ,
Zeeshan Zia ,
Ying Chen ,
Alexander Schwing ,
Gang Hua
Under Review
Paper
/
Website
/
Code
VideoSketcher: Sequential Sketch Generation Using Video Model Priors
Hui Ren ,
Yuval Alaluf ,
Omer Bar Tal ,
Alexander Schwing ,
Antonio Torralba ,
Yael Vinker
Under Review
Paper
/
Website
/
Code
Opt-In Art: Learning Art Styles Only from Few Examples
Hui Ren* ,
Joanna Materzyńska* ,
Rohit Gandikota ,
Giannis Daras,
David Bau ,
Antonio Torralba
NeurIPS, 2025
Paper
/
Website
/
Code
/
Demo
Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields
Shijie Zhou* ,
Hui Ren* ,
Yijia Weng ,
Shuwang Zhang ,
Zhen Wang ,
Dejia Xu ,
Zhiwen Fan ,
Suya You ,
Zhangyang Wang ,
Leonidas Guibas ,
Achuta Kadambi
CVPR , 2025
Paper
/
Website
/
Code
P2 OT: Progressive Partial Optimal Transport for Deep Imbalanced
Clustering
Chuyu Zhang* ,
Hui Ren* ,
Xuming He
ICLR , 2024
Paper
/
Code
SP2 OT: Semantic-Regularized Progressive Partial Optimal Transport for Imbalanced Clustering
Chuyu Zhang ,
Hui Ren ,
Xuming He
arXiv , 2024
Paper
/
Code
Your browser does not support the video tag.
Dual-level Adaptive Self-Labeling for Novel Class Discovery in Point Cloud Segmentation
Ruijie Xu* ,
Chuyu Zhang* ,
Hui Ren ,
Xuming He
ECCV , 2024
Paper /
Code
Cascaded Sparse Feature Propagation Network for Interactive Segmentation
Chuyu Zhang* ,
Chuanyang Hu* ,
Hui Ren ,
Yongfei Liu ,
Xuming He
BMVC , 2023
Paper /
Code
Activities
Spring 2025: Teaching Assistant in CS182 Introduction to Machine Learning
May 2024: Attend and present poster at ICLR 2024, Vienna, Austria
Fall 2022: Teaching Assistant in SI100B Introduction to Information Science and Technology
Academic Service
2026: Reviewer, NeurIPS 2026
2026: Reviewer, How Do Vision Models Work (HOW) , CVPR 2026 Workshop
Selected Awards and Honors
2025: Amazon AI PhD Fellowship
2025: Shanghai & University's Outstanding Graduate (Top 5% in school)
2024: National Scholarship (Top 0.2% nationwide, highest scholarship in China)
2024: Outstanding Student (Ranked top 2% in school)
2024: International Exchange Program First-class Scholarship (Top 2% in school)
2023: Outstanding Student (Ranked top 2% in school)
2023: Third prize , The 14th Chinese Mathematics Competition
2022: Merit Student (Ranked top 3%-7% in school)
2019: First prize , The 5th Annual International Mathematical
Modeling Challenge, Greater China Region Contest
This homepage is designed based on Jon Barron 's website.
© 2023-2026 Hui Ren