Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Face loss for face reconstruction #31

Closed
kl2004 opened this issue Aug 15, 2024 · 2 comments
Closed

Face loss for face reconstruction #31

kl2004 opened this issue Aug 15, 2024 · 2 comments

Comments

@kl2004
Copy link

kl2004 commented Aug 15, 2024

Thanks for sharing the code!

I tried the checkpoint IN256_Base on face images, but the faces in the reconstructed images are not great. I wonder how the reconstructed faces could be improved. Do you plan to include face loss in the total loss?

@vinyesm
Copy link

vinyesm commented Sep 9, 2024

Same observation, here an example with imagenet_256_L. But I think it could be related to training data
Screenshot 2024-09-09 at 17 49 15

@RobertLuo1
Copy link
Collaborator

RobertLuo1 commented Jan 22, 2025

Hi, there, since the face image is hard to collect and the current scale of face images is limited. Considering the downsampling rate which also causes difficulty in accurately reconstructing the small detailed object such as face, we currently seek for more feasible way to solve that problem.
By the way, we observe that including more training data will benefit which can be shown in our pretrain tokenizer version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants