-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tensorflow2.x version #4
Comments
Coming up soon even though I've never written a line of tensorflow ever, I'll do it for you 😊 |
Will the tensorflow version be released soon? Looking forward to it. |
any update ? |
If you are still looking for something like this, I have made one based on the author's implementation. Located at https://github.com/vrusaeva/SophiaTF. Would appreciate if you told me results with it, as I do not have the compute to test it on a large model/dataset and am not seeing the 2x improvements over Adam on the very small model/dataset I am using (though there is a non-negligible improvement in training convergence at the cost of some wall-clock time per epoch). |
Upvote & Fund
The text was updated successfully, but these errors were encountered: