Lumen dirty test #31
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,13 +1,76 @@ | ||
| <div align="center"><a href="https://github.com/aclai-lab/Sole.jl"><img src="logo.png" alt="" title="This package is part of Sole.jl" width="200"></a></div> | ||
|
|
||
| # SolePostHoc.jl – Post-Hoc Analysis for Symbolic Learning | ||
| 🚧 This package is under construction. 🚧 | ||
|
|
||
|
|
||
| [](https://aclai-lab.github.io/SolePostHoc.jl/stable) | ||
| [](https://cirrus-ci.com/github/aclai-lab/SolePostHoc.jl) | ||
| [](https://codecov.io/gh/aclai-lab/SolePostHoc.jl) | ||
|
|
||
| ## In a nutshell | ||
|
|
||
| *SolePostHoc.jl* is dedicated to post-hoc analysis and optimization of symbolic learning models. It provides a comprehensive suite of algorithms for: | ||
| - Rule extraction from both symbolic and non-symbolic models | ||
| - Rule minimization and optimization | ||
| - Model transformation and enhancement | ||
| - Interpretability analysis | ||
|
|
||
| ## Key Features | ||
|
|
||
| ### Rule Extraction and Model Optimization | ||
| - Extraction of comprehensible rules from complex models | ||
| - Support for various source models: | ||
| - Decision trees and random forests | ||
| - Black-box models | ||
| - A clean Rule extraction interface (`SolePostHoc.modalextractrules`) | ||
| - Implementation of state-of-the-art algorithms: | ||
| - LUMEN (L: Logic-driven U: Unified M: Minimal E: Extractor of N: Notions) | ||
| - InTrees (Interpret Tree Ensembles) | ||
| - TREPAN | ||
| - REFNE | ||
| - have binding with other state-of-the-art algorithms | ||
| - binding to RuleCOSI(+) | ||
| - BATrees (Born Again Trees) | ||
| ### Through these we guarantee | ||
| - Rule minimization techniques | ||
| - Model simplification while preserving accuracy | ||
| - Performance enhancement through post-processing | ||
|
|
||
| ### Integration | ||
| - Seamless integration with other Sole.jl packages | ||
|
|
||
|
|
||
| ## Usage Example | ||
|
|
||
| ```julia | ||
| # Load packages | ||
| using SolePostHoc | ||
| using SoleModels | ||
| using MLJ | ||
|
|
||
| # Load and prepare a model (e.g., a random forest) | ||
| 🌳 = load_model("your_model.jl") | ||
|
There was a problem hiding this comment. But how about instead of or by means of parsing: Btw I like Ps Nice iconography with the emojis! |
||
|
|
||
| # Extract rules | ||
| 🍃 = modalextractrules(RuleExtractor = LumenRuleExtractor,🌳) | ||
|
There was a problem hiding this comment.
There was a problem hiding this comment. There's a space missing before 🌳 There was a problem hiding this comment. "modalextractrules -> extractrules" it's a request from the professor... he preferred this one... "There's a space missing before 🌳" wow I hadn't noticed that There was a problem hiding this comment. There is not a single |
||
|
|
||
| # View metrics | ||
| printmetrics(🍃) | ||
| ``` | ||
|
|
||
|
|
||
| ## Want to know more? | ||
| For the theoretical foundations of Sole framework, refer to: | ||
| [*Modal Symbolic Learning: from theory to practice*, G. Pagliarini (2024)](https://scholar.google.com/citations?view_op=view_citation&hl=en&user=FRo4yrcAAAAJ&citation_for_view=FRo4yrcAAAAJ:LkGwnXOMwfcC) | ||
|
|
||
|
Comment on lines
+63
to
+66
There was a problem hiding this comment. Maybe here it's better if we refer to the Sole.jl github, so that mantaining references is less of a burden? Similar to https://github.com/aclai-lab/SoleLogics.jl?tab=readme-ov-file#about But I see that SoleModels also has this same footer https://github.com/aclai-lab/SoleModels.jl?tab=readme-ov-file#want-to-know-more SoleData is even more different... https://github.com/aclai-lab/SoleData.jl We probably should choose one style of referencing to Sole and its background, and stick with it across all packages like SoleLogics and SoleData. I don't know which style is the correct one. Thoughts? @ferdiu @alberto-paparella @mauro-milella ? There was a problem hiding this comment. a great talking point for a Sole Reunion There was a problem hiding this comment. I think the more maintainable between all of them is the one present in SoleModels you linked. I also liked the idea of the Similar Julia Packages from SoleLogics but it is going to be hard to keep it up-to-date so I would not go down that path for all packages. I would go with SoleModels model 😝 for the footer of the READMEs. There was a problem hiding this comment. I agree with @ferdiu, I also prefer the one from |
||
| ## About | ||
|
|
||
| The package is developed by the [ACLAI Lab](https://aclai.unife.it/en/) @ University of Ferrara. | ||
|
|
||
| ## More on Sole | ||
| *SolePostHoc.jl* is part of the [*Sole.jl*](https://github.com/aclai-lab/Sole.jl) ecosystem, working alongside: | ||
| - [SoleLogics.jl](https://github.com/aclai-lab/SoleLogics.jl): Logical foundations | ||
| - [SoleData.jl](https://github.com/aclai-lab/SoleData.jl): Data handling | ||
| - [SoleModels.jl](https://github.com/aclai-lab/SoleModels.jl): Model definitions | ||
| - [SoleFeatures.jl](https://github.com/aclai-lab/SoleFeatures.jl): Feature engineering | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| # TODO | ||
|
|
||
|
|
||
| ## LUMEN | ||
| - Remove Italian sentences | ||
| - | ||
|
|
||
| ## BA-Trees | ||
| BA-Trees must be integrated well as a `RuleExtraction` object. Some first steps: | ||
| - Separate forest learning, forest simplification, and algorithm testing logics. | ||
| - Write a function that translates decision forests to BA-tree txt format. | ||
| - Write a function that translates ANY (non-bag) symbolic model to BA-tree txt format. Remember that any non-bag model can be seen as a particular case of a forest (ensemble of trees), via a polynomial reduction | ||
| - Build object `BATreesRuleExtraction`, which outputs a SoleModel.DecisionTree. Be careful: clarify the assumpions on the symbolic model type, or the underlying logical language | ||
| - Can we extend it to the modal level? |
Empty file.
Empty file.
Empty file.
Empty file.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Perro2110 marked this conversation as resolved.
Show resolved
Hide resolved
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,151 @@ | ||
| 4 150 4 | ||
| 5.1 3.5 1.4 0.2 | ||
| 4.9 3.0 1.4 0.2 | ||
| 4.7 3.2 1.3 0.2 | ||
| 4.6 3.1 1.5 0.2 | ||
| 5.0 3.6 1.4 0.2 | ||
| 5.4 3.9 1.7 0.4 | ||
| 4.6 3.4 1.4 0.3 | ||
| 5.0 3.4 1.5 0.2 | ||
| 4.4 2.9 1.4 0.2 | ||
| 4.9 3.1 1.5 0.1 | ||
| 5.4 3.7 1.5 0.2 | ||
| 4.8 3.4 1.6 0.2 | ||
| 4.8 3.0 1.4 0.1 | ||
| 4.3 3.0 1.1 0.1 | ||
| 5.8 4.0 1.2 0.2 | ||
| 5.7 4.4 1.5 0.4 | ||
| 5.4 3.9 1.3 0.4 | ||
| 5.1 3.5 1.4 0.3 | ||
| 5.7 3.8 1.7 0.3 | ||
| 5.1 3.8 1.5 0.3 | ||
| 5.4 3.4 1.7 0.2 | ||
| 5.1 3.7 1.5 0.4 | ||
| 4.6 3.6 1.0 0.2 | ||
| 5.1 3.3 1.7 0.5 | ||
| 4.8 3.4 1.9 0.2 | ||
| 5.0 3.0 1.6 0.2 | ||
| 5.0 3.4 1.6 0.4 | ||
| 5.2 3.5 1.5 0.2 | ||
| 5.2 3.4 1.4 0.2 | ||
| 4.7 3.2 1.6 0.2 | ||
| 4.8 3.1 1.6 0.2 | ||
| 5.4 3.4 1.5 0.4 | ||
| 5.2 4.1 1.5 0.1 | ||
| 5.5 4.2 1.4 0.2 | ||
| 4.9 3.1 1.5 0.2 | ||
| 5.0 3.2 1.2 0.2 | ||
| 5.5 3.5 1.3 0.2 | ||
| 4.9 3.6 1.4 0.1 | ||
| 4.4 3.0 1.3 0.2 | ||
| 5.1 3.4 1.5 0.2 | ||
| 5.0 3.5 1.3 0.3 | ||
| 4.5 2.3 1.3 0.3 | ||
| 4.4 3.2 1.3 0.2 | ||
| 5.0 3.5 1.6 0.6 | ||
| 5.1 3.8 1.9 0.4 | ||
| 4.8 3.0 1.4 0.3 | ||
| 5.1 3.8 1.6 0.2 | ||
| 4.6 3.2 1.4 0.2 | ||
| 5.3 3.7 1.5 0.2 | ||
| 5.0 3.3 1.4 0.2 | ||
| 7.0 3.2 4.7 1.4 | ||
| 6.4 3.2 4.5 1.5 | ||
| 6.9 3.1 4.9 1.5 | ||
| 5.5 2.3 4.0 1.3 | ||
| 6.5 2.8 4.6 1.5 | ||
| 5.7 2.8 4.5 1.3 | ||
| 6.3 3.3 4.7 1.6 | ||
| 4.9 2.4 3.3 1.0 | ||
| 6.6 2.9 4.6 1.3 | ||
| 5.2 2.7 3.9 1.4 | ||
| 5.0 2.0 3.5 1.0 | ||
| 5.9 3.0 4.2 1.5 | ||
| 6.0 2.2 4.0 1.0 | ||
| 6.1 2.9 4.7 1.4 | ||
| 5.6 2.9 3.6 1.3 | ||
| 6.7 3.1 4.4 1.4 | ||
| 5.6 3.0 4.5 1.5 | ||
| 5.8 2.7 4.1 1.0 | ||
| 6.2 2.2 4.5 1.5 | ||
| 5.6 2.5 3.9 1.1 | ||
| 5.9 3.2 4.8 1.8 | ||
| 6.1 2.8 4.0 1.3 | ||
| 6.3 2.5 4.9 1.5 | ||
| 6.1 2.8 4.7 1.2 | ||
| 6.4 2.9 4.3 1.3 | ||
| 6.6 3.0 4.4 1.4 | ||
| 6.8 2.8 4.8 1.4 | ||
| 6.7 3.0 5.0 1.7 | ||
| 6.0 2.9 4.5 1.5 | ||
| 5.7 2.6 3.5 1.0 | ||
| 5.5 2.4 3.8 1.1 | ||
| 5.5 2.4 3.7 1.0 | ||
| 5.8 2.7 3.9 1.2 | ||
| 6.0 2.7 5.1 1.6 | ||
| 5.4 3.0 4.5 1.5 | ||
| 6.0 3.4 4.5 1.6 | ||
| 6.7 3.1 4.7 1.5 | ||
| 6.3 2.3 4.4 1.3 | ||
| 5.6 3.0 4.1 1.3 | ||
| 5.5 2.5 4.0 1.3 | ||
| 5.5 2.6 4.4 1.2 | ||
| 6.1 3.0 4.6 1.4 | ||
| 5.8 2.6 4.0 1.2 | ||
| 5.0 2.3 3.3 1.0 | ||
| 5.6 2.7 4.2 1.3 | ||
| 5.7 3.0 4.2 1.2 | ||
| 5.7 2.9 4.2 1.3 | ||
| 6.2 2.9 4.3 1.3 | ||
| 5.1 2.5 3.0 1.1 | ||
| 5.7 2.8 4.1 1.3 | ||
| 6.3 3.3 6.0 2.5 | ||
| 5.8 2.7 5.1 1.9 | ||
| 7.1 3.0 5.9 2.1 | ||
| 6.3 2.9 5.6 1.8 | ||
| 6.5 3.0 5.8 2.2 | ||
| 7.6 3.0 6.6 2.1 | ||
| 4.9 2.5 4.5 1.7 | ||
| 7.3 2.9 6.3 1.8 | ||
| 6.7 2.5 5.8 1.8 | ||
| 7.2 3.6 6.1 2.5 | ||
| 6.5 3.2 5.1 2.0 | ||
| 6.4 2.7 5.3 1.9 | ||
| 6.8 3.0 5.5 2.1 | ||
| 5.7 2.5 5.0 2.0 | ||
| 5.8 2.8 5.1 2.4 | ||
| 6.4 3.2 5.3 2.3 | ||
| 6.5 3.0 5.5 1.8 | ||
| 7.7 3.8 6.7 2.2 | ||
| 7.7 2.6 6.9 2.3 | ||
| 6.0 2.2 5.0 1.5 | ||
| 6.9 3.2 5.7 2.3 | ||
| 5.6 2.8 4.9 2.0 | ||
| 7.7 2.8 6.7 2.0 | ||
| 6.3 2.7 4.9 1.8 | ||
| 6.7 3.3 5.7 2.1 | ||
| 7.2 3.2 6.0 1.8 | ||
| 6.2 2.8 4.8 1.8 | ||
| 6.1 3.0 4.9 1.8 | ||
| 6.4 2.8 5.6 2.1 | ||
| 7.2 3.0 5.8 1.6 | ||
| 7.4 2.8 6.1 1.9 | ||
| 7.9 3.8 6.4 2.0 | ||
| 6.4 2.8 5.6 2.2 | ||
| 6.3 2.8 5.1 1.5 | ||
| 6.1 2.6 5.6 1.4 | ||
| 7.7 3.0 6.1 2.3 | ||
| 6.3 3.4 5.6 2.4 | ||
| 6.4 3.1 5.5 1.8 | ||
| 6.0 3.0 4.8 1.8 | ||
| 6.9 3.1 5.4 2.1 | ||
| 6.7 3.1 5.6 2.4 | ||
| 6.9 3.1 5.1 2.3 | ||
| 5.8 2.7 5.1 1.9 | ||
| 6.8 3.2 5.9 2.3 | ||
| 6.7 3.3 5.7 2.5 | ||
| 6.7 3.0 5.2 2.3 | ||
| 6.3 2.5 5.0 1.9 | ||
| 6.5 3.0 5.2 2.0 | ||
| 6.2 3.4 5.4 2.3 | ||
| 5.9 3.0 5.1 1.8 |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should clean all of these dependencies, we can't have this many. If needed, we should do package extensions e.g., for DecisionTree.jl
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes I have to put myself there! now start