Reduce memory usage #82

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

mj023 wants to merge 3 commits into endogenize_investments from reduce_memory

Collaborator

mj023 commented Apr 7, 2025 •

edited

Loading

This PR introduces multiple measures to reduce the memory usage of the gradient computation in skillmodels.

Move rematerialization checkpoint to the scans body function
Introduce the option to split the dataset and then add up the gradient values to save memory
Improve householder product with faster matrix updating

mj023 added 3 commits

April 7, 2025 21:03


          Move Checkpoints

898e6cd


          Add splitting for gradient

1879a5b


          Speed up QR

d778902

mj023 requested a review from hmgaudecker

April 27, 2025 15:46

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet