Advances in 4D Generation: A Survey

Qiaowei Miao, Kehan Li, Jinsheng Quan, Zhiyuan Min, Shaojie Ma, Yichao Xu, Yi Yang, and Yawei Luo⁺.

⁺ Corresponding Author.

---

We welcome authors of other 4D generation-related works to share their contributions and help expand this field together. Please feel free to contact [email protected], and we will regularly update your work in the repository and the main text. If you use WeChat, you are also welcome to reach out to: JoviMeow.

This repository is a collection of awesome things about papers, codes, datasets, etc.

If you would like to contribute to our repository or have any questions/advice.

Papers

---

We list the papers about 4D generation.

MVTokenFlow: High-quality 4D Content Generation using Multiview Token Flow (2025.2)

Authors: Hanzhuo Huang, Yuan Liu, Ge Zheng, Jiepeng Wang, Zhiyang Dou, Sibei Yang

📄 Paper | 🌐 Project Page | 💻 Code

AR4D: Autoregressive 4D Generation from Monocular Videos (2025.1)

Authors: Hanzhuo Huang, Yuan Liu, Ge Zheng, Jiepeng Wang, Zhiyang Dou, Sibei Yang

📄 Paper | 🌐 Project Page | 💻 Code

PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting (2024.11)

Authors: Qiaowei Miao, JinSheng Quan, Kehan Li, Yawei Luo

📄 Paper

4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models (2024.11)

Authors: Heng Yu, Chaoyang Wang, Peiye Zhuang, Willi Menapace, Aliaksandr Siarohin, Junli Cao, Laszlo A Jeni, Sergey Tulyakov, Hsin-Ying Lee

📄 Paper | 🌐 Project Page

DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representation (2024.10)

Authors: Zhiqi Li, Yiming Chen, Peidong Liu

📄 Paper | 🌐 Project Page | 💻 Code

AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation (2024.10)

Authors: Yukang Cao, Liang Pan, Kai Han, Kwan-Yee K. Wong, Ziwei Liu

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

ElastoGen: 4D Generative Elastodynamics (2024.10)

Authors: Yutao Feng, Yintong Shang, Xiang Feng, Lei Lan, Shandian Zhe, Tianjia Shao, Hongzhi Wu, Kun Zhou, Hao Su, Chenfanfu Jiang, Yin Yang

📄 Paper | 🌐 Project Page | 🎥 Short Presentation

4Diffusion: Multi-view Video Diffusion Model for 4D Generation (2024.10)

Authors: Haiyu Zhang, Xinyuan Chen, Yaohui Wang, Xihui Liu, Yunhong Wang, Yu Qiao

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

Diffusion²: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Models (2024.10)

Authors: Zeyu Yang, Zijie Pan, Chun Gu, Li Zhang

📄 Paper

TC4D: Trajectory-Conditioned Text-to-4D Generation (2024.10)

Authors: Sherwin Bahmani, Xian Liu, Wang Yifan, Ivan Skorokhodov, Victor Rong, Ziwei Liu, Xihui Liu, Jeong Joon Park, Sergey Tulyakov, Gordon Wetzstein, Andrea Tagliasacchi, David B. Lindell

📄 Paper | 🌐 Project Page | 💻 Code

Sketch-2-4D: Sketch driven dynamic 3D scene generation (2024.10)

Authors: Guo-Wei Yang, Dong-Yu Chen, Tai-Jiang Mu

📄 Paper

Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesis (2024.10)

Authors: Bohan Zeng, Ling Yang, Siyu Li, Jiaming Liu, Zixiang Zhang, Juanxi Tian, Kaixin Zhu, Yongzhen Guo, Fu-Yun Wang, Minkai Xu, Stefano Ermon, Wentao Zhang

📄 Paper | 🌐 Project Page

Compositional 3D-aware Video Generation with LLM Director (2024.9)

Authors: Hanzhuo Huang, Yuan Liu, Ge Zheng, Jiepeng Wang, Zhiyang Dou, Sibei Yang

📄 Paper

Phy124: Fast Physics-Driven 4D Content Generation from a Single Image (2024.9)

Authors: Jiajing Lin, Zhenzhong Wang, Yongjie Hou, Yuzhou Tang, Min Jiang

📄 Paper | 🌐 Project Page

Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformer (2024.9)

Authors: Ruizhi Shao, Youxin Pang, Zerong Zheng, Jingxiang Sun, Yebin Liu

📄 Paper | 🌐 Project Page | 💻 Code | 📀 Dataset

Disco4D: Disentangled 4D Human Generation and Animation from a Single Image (2024.9)

Authors: Hui En Pang, Shuai Liu, Zhongang Cai, Lei Yang, Tianwei Zhang, Ziwei Liu

📄 Paper | 🌐 Project Page | 💻 Code

SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer (2024.8)

Authors: Zijie Wu, Chaohui Yu, Yanqin Jiang, Chenjie Cao, Fan Wang, Xiang Bai

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

CT4D: Consistent Text-to-4D Generation with Animatable Meshes (2024.8)

Authors: Ce Chen, Shaoli Huang, Xuelin Chen, Guangyi Chen, Xiaoguang Han, Kun Zhang, Mingming Gong

📄 Paper

SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency (2024.7)

Authors: Yiming Xie, Chun-Han Yao1, Vikram Voleti1, Huaizu Jiang, Varun Jampani

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation (2024.7)

Authors: Zhoujie Fu, Jiacheng Wei, Wenhao Shen, Chaoyue Song, Xiaofeng Yang, Fayao Liu, Xulei Yang, Guosheng Lin

📄 Paper | 🌐 Project Page

4Dynamic: Text-to-4D Generation with Hybrid Priors (2024.7)

Authors: Yu-Jie Yuan, Leif Kobbelt, Jiwen Liu, Yuan Zhang, Pengfei Wan, Yu-Kun Lai, Lin Gao

📄 Paper

L4GM: Large 4D Gaussian Reconstruction Model (2024.6)

Authors: Jiawei Ren, Kevin Xie, Ashkan Mirzaei, Hanxue Liang, Xiaohui Zeng, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling

📄 Paper | 🌐 Project Page | 💻 Code

STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargeting (2024.6)

Authors: Zenghao Chai, Chen Tang, Yongkang Wong, Mohan Kankanhalli

📄 Paper | 🌐 Project Page | 💻 Code

EG4D: Explicit Generation of 4D Object without Score Distillation (2024.5)

Authors: Qi Sun, Zhiyang Guo, Ziyu Wan, Jing Nathan Yan, Shengming Yin, Wengang Zhou, Jing Liao, Houqiang Li

📄 Paper | 💻 Code

Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models (2024.5)

Authors: Hanwen Liang, Yuyang Yin, Dejia Xu, Hanxue Liang, Zhangyang Wang, Konstantinos N. Plataniotis, Yao Zhao, Yunchao Wei

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation | 📀 Dataset

A Unified Approach for Text- and Image-guided 4D Scene Generation (2024.5)

Authors: Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello

📄 Paper | 🌐 Project Page | 💻 Code

4K4DGen: Panoramic 4D Generation at 4K Resolution (2024.3)

Authors: Renjie Li, Panwang Pan, Bangbang Yang, Dejia Xu, Shijie Zhou, Xuanyang Zhang, Zeming Li, Achuta Kadambi, Zhangyang Wang, Zhengzhong Tu, Zhiwen Fan

📄 Paper | 🌐 Project Page | 🎥 Short Presentation

Beyond Skeletons: Integrative Latent Mapping for Coherent 4D Sequence Generation (2024.3)

Authors: Qitong Yang, Mingtao Feng, Zijie Wu, Shijie Sun, Weisheng Dong, Yaonan Wang, Ajmal Mian

📄 Paper

Comp4D: LLM-Guided Compositional 4D Scene Generation (2024.3)

Authors: Dejia Xu, Hanwen Liang, Neel P. Bhatt, Hezhen Hu, Hanxue Liang, Konstantinos N. Plataniotis, Zhangyang Wang

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

Animate124: Animating One Image to 4D Dynamic Scene (2024.2)

Authors: Yuyang Zhao, Zhiwen Yan, Enze Xie, Lanqing Hong, Zhenguo Li, Gim Hee Lee

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency (2023.12)

Authors: Yuyang Yin, Dejia Xu, Zhangyang Wang, Yao Zhao, Yunchao Wei

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation

DreamGaussian4D: Generative 4D Gaussian Splatting (2023.12)

Authors: Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, Ziwei Liu

📄 Paper | 🌐 Project Page | 💻 Code

Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models (2023.12)

Authors: Andreas Blattmann, Robin Rombach, Huan Ling, Tim Dockhorn, Seung Wook Kim, Sanja Fidler, Karsten Kreis

📄 Paper | 🌐 Project Page

AnimatableDreamer: Text-Guided Non-rigid 3D Model Generation and Reconstruction with Canonical Score Distillation (2023.12)

Authors: Xinzhou Wang, Yikai Wang, Junliang Ye, Zhengyi Wang, Fuchun Sun, Pengkun Liu, Ling Wang, Kai Sun, Xintong Wang, Bin He

📄 Paper | 🌐 Project Page

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models (2023.12)

Authors: Shengqu Cai, Duygu Ceylan, Matheus Gadelha, Chun-Hao Paul Huang, Tuanfeng Yang Wang, Gordon Wetzstein

📄 Paper | 🌐 Project Page

4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling (2023.11)

Authors: Sherwin Bahmani, Ivan Skorokhodov, Victor Rong, Gordon Wetzstein, Leonidas Guibas, Peter Wonka, Sergey Tulyakov, Jeong Joon Park, Andrea Tagliasacchi, David B. Lindell

📄 Paper | 🌐 Project Page | 💻 Code

A Unified Approach for Text- and Image-guided 4D Scene Generation (2023.11)

Authors: Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello

📄 Paper

Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video (2023.11)

Authors:Yanqin Jiang, Li Zhang, Jin Gao, Weimin Hu, Yao Yao

📄 Paper | 🌐 Project Page | 💻 Code

Animate124: Animating One Image to 4D Dynamic Scene (2023.11)

Authors: Yuyang Zhao, Zhiwen Yan, Enze Xie, Lanqing Hong, Zhenguo Li, Gim Hee Lee

📄 Paper | 🌐 Project Page | 💻 Code| 🎥 Short Presentation

HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion (2023.3)

Authors: Ziya Erkoç, Fangchang Ma, Qi Shan, Matthias Nießner, Angela Dai

📄 Paper | 🌐 Project Page | 💻 Code | 🎥 Short Presentation | 📀 Dataset

Text-To-4D Dynamic Scene Generation (2023.1)

Authors: Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman

📄 Paper | 🌐 Project Page