Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whether it is difficult to train or debug? #44

Closed
HalvesChen opened this issue Dec 15, 2024 · 3 comments
Closed

Whether it is difficult to train or debug? #44

HalvesChen opened this issue Dec 15, 2024 · 3 comments

Comments

@HalvesChen
Copy link

Thank you for your excellent work, I would like to ask if the training of the model is stable after using IBQ? If you can, please provide some experimental considerations

@ShiFengyuan1999
Copy link
Collaborator

Hi @HalvesChen. Yes, the training of IBQ model is very stable. There are no sudden loss spikes in all our experiments. Actually, it is easy to train IBQ and get good results without special training tricks. Of course, you can also apply some training tricks, such as LeCAM regularization, to further improve the stability of the model training.

@HalvesChen
Copy link
Author

Thanks~

@HalvesChen
Copy link
Author

Hi,
I notice that your method requires much more epoch(330) than other methods. Have you compared the reconstruction performance of the common setting (epoch=50)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants