add mlr3 and renv gallery post #141
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
be-marc
commented
Dec 6, 2023
be-marc
commented
Dec 6, 2023
be-marc
commented
Dec 6, 2023
| lxy = list(x, y) | ||
| object_size(lx) | ||
| object_size(lxy) | ||
| ``` |
Member
Author
There was a problem hiding this comment.
I like the example because it is easy to understand but it is not clear where this happens in mlr3. Maybe mention the repeated storing of our objects in benchmark results.
be-marc
commented
Dec 6, 2023
| ``` | ||
|
|
||
|
|
||
| When serializing `mlr3` objects, it can happen that their size is much larger than expected. |
Member
Author
There was a problem hiding this comment.
Maybe start with non-technical term like storing mlr3 objects.
be-marc
commented
Dec 6, 2023
| Because `Learner`s store the hyperparameters that were used for training in their `$state`, it is important to ensure that their size is small. | ||
| One cause for large sizes of parameter values is the presence of source references in the function's attributes. | ||
| Source references are kept when installing packages with the `--with-keep.source` option. | ||
| Note that this option is enabled by default when installing packages with `renv`. |
Member
Author
There was a problem hiding this comment.
Mention that installing with source refs is not the normal case but I would point out renv earlier. How can I check that mlr3 was installed with source refs?
be-marc
commented
Dec 6, 2023
|
|
||
| Another -- easily amendable -- source for large object sizes is forgetting to set the right flags. | ||
| The list below contains some important configuration options that can be used to reduce the size of important `mlr3` objects: | ||
|
|
Member
Author
There was a problem hiding this comment.
Link to the book. This is explained in detail there.
be-marc
commented
Dec 6, 2023
| We will update this post as new problems come to our attention. | ||
| Note that while some of these issues might seem neglibile, they can cause serious problems when running large benchmrk experiments, e.g. using `mlr3batchmark`. | ||
|
|
||
| ## Avoid Installating Packages With Source References |
Member
Author
There was a problem hiding this comment.
Maybe mention renv right in the heading.
Co-authored-by: Marc Becker <[email protected]>
Co-authored-by: Marc Becker <[email protected]>
Member
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.