Motion-aware Autoregressive Generation

[ZyuanW]

Hi, thanks for your work!
May i ask where in the code the sampling of M historical frames as input is implemented? Could you kindly point me to the relevant part of the codebase or provide a brief explanation?

[Jieqianyu]

Thank you for your interest! For more details, you can refer to the build_clips function in this file.

[ZyuanW]

Thank you for your interest! For more details, you can refer to the build_clips function in this file.

and may i ask what's the main different between base dreamer and dreamforge? is the baseDreamer an autoregressive model? btw，what is the relationship between 'current video clip and "Motion frames"?

[Jieqianyu]

Thank you for your interest! The main difference between Base Dreamer and DreamForge is that the former is a single-frame version, while the latter is a video version. In DreamForge, motion frames are sampled from the previous clip. For more details, you can refer to the Arxiv paper.