Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于MAE-B 8X8 在finetune过程中的计算量问题 #4

Open
yukimmmmiao opened this issue Aug 10, 2023 · 1 comment
Open

关于MAE-B 8X8 在finetune过程中的计算量问题 #4

yukimmmmiao opened this issue Aug 10, 2023 · 1 comment

Comments

@yukimmmmiao
Copy link

首先感谢你们做出的优秀工作！
在读完论文之后我有一个问题：论文中表现十分优秀的模型MAE-B 8X8 在finetune过程以及后续的evaluate过程的图像输入尺寸都是224X224的吗？这样是不是会让计算量提升4倍？
@ucasligang
Copy link
Owner

是的，MAE-B 8X8 在finetune过程以及后续的evaluate过程的图像输入尺寸都是224X224的，计算量在self-attention那部分确实理论上会提升4倍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ucasligang @yukimmmmiao