从 transformer架构上来讲，Dream 和 LLADA 有什么本质区别吗 #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

maomaocun opened this issue Apr 3, 2025 · 1 comment

maomaocun commented Apr 3, 2025

No description provided.

Contributor

jiacheng-ye commented Apr 5, 2025

你好，架构层面其实都差不多，小区别就是因为Dream是从AR adapt的，所以每个mask position是对应到下一个的token，以及Dream是从Qwen来的，所以和Qwen的结构更接近。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment