9.3 release of Microsoft.Extensions.AI.Evaluation libraries #6100
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…6078) * Add types from AIJsonUtilities.JsonContext to reporting JsonContext * Add a few more tests * Chain M.E.AI.Eval serialization types through AIJsonUtilities * Fix reversed Compact/Default * Rename some of the types.
Also includes changes to the report to display this information. This addresses #6032. Additionally, this PR also includes numerous general improvements to the TypeScript report rendering - * Make the metric cards clickable and display metric details (such as diagnostics, reasons etc.) on click in a new collapsible section inline in the report (as opposed to in a hover tooltip). This addresses #6037. * Show conversations in a friendlier chat bubble form and make the sections that display conversation history collapsible so that long conversations can be collapsed. This addresses #6036 partially. * Introduce a global settings pane and move the per-textbox toggles for rendering markdown to the global location. This also addresses #6036 partially. * In the scenario tree, collapse single children into their respective parent level to reduce the amount of clicking required to expand deep trees. * Remove the scenario-level section for failure reasons since it is now possible to view failure reasons (and diagnostics) on a per-metric basis by clicking on metric cards. * A bunch of other minor layout, sizing and UX improvements and fixes for the report.
...xtensions.AI.Evaluation.Reporting/CSharp/Microsoft.Extensions.AI.Evaluation.Reporting.csproj
Show resolved
Hide resolved
joperezr
reviewed
Mar 13, 2025
src/Libraries/Microsoft.Extensions.AI.Evaluation/Microsoft.Extensions.AI.Evaluation.csproj
Show resolved
Hide resolved
joperezr
reviewed
Mar 13, 2025
....AI.Evaluation.Integration.Tests/Microsoft.Extensions.AI.Evaluation.Integration.Tests.csproj
Show resolved
Hide resolved
shyamnamboodiripad
approved these changes
Mar 13, 2025
joperezr
approved these changes
Mar 13, 2025
|
Thanks for the approval @joperezr. Just a heads up that I am not able to merge the PR. Feel free to complete it whenever you are ready.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Note that we updated the Microsoft.Extensions.AI references to the published version. If another release happens later on this branch, we may want to update that.
cc @joperezr
Microsoft Reviewers: Open in CodeFlow