-
Couldn't load subscription status.
- Fork 722
[ENH] add feature scaling support for EncoderDecoderDataModule
#1983
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1983 +/- ##
=======================================
Coverage ? 86.67%
=======================================
Files ? 160
Lines ? 9540
Branches ? 0
=======================================
Hits ? 8269
Misses ? 1271
Partials ? 0
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
Tests are failing on the notebook. Seems like its an issue caused by the training script in the notebook. Will try changing accelator = "cpu". Might resolve the issue. |
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
| requires_grad = feature_data.requires_grad | ||
| device = feature_data.device | ||
| feature_data_np = ( | ||
| feature_data.cpu().detach().numpy().reshape(-1, 1) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have doubt: Wouldn't using detach again detach the tensor from the computation graph? That would again lead to the same issue?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As far as my knowledge of pytorch goes, I think it's a good practice to use .detach() before converting the pytorch tensor to a numpy array. Anyways, the numpy array will not track the gradients, so this won't matter.
|
I think we could look at v1 implementation? Maybe that could help us with this issue, how the |
|
Yes we will need a design doc to analyse v1 implementation. This is the best way forward. |
|
agree - it seems like one more rabbit hole... Is there perhaps something we can learn from |
Reference Issues/PRs
fixes #1979
What does this implement/fix? Explain your changes.
Implements feature scaling for continuous targets and features in the D2 layer using scalers and target_normalizer params.
What should a reviewer concentrate their feedback on?
PR checklist
pre-commit install.To run hooks independent of commit, execute
pre-commit run --all-files