-
Notifications
You must be signed in to change notification settings - Fork 549
[tests] Improve test summary to include up to 3 failing unit tests. #24282
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR improves test result summaries by adding detailed information about up to 3 failing unit tests from TRX test result files. The changes introduce a new TRX parser utility that extracts test failure details and integrates it into multiple reporting systems.
- Adds a new
TrxParserutility class to parse TRX test result files and extract failed test information - Updates markdown and HTML report writers to display the first 3 failing tests with truncated names and messages
- Modifies PowerShell test results script to include parsed TRX content in summaries
Reviewed Changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/common/ParseTrxFile.cs | New TRX parser utility class that extracts failed test information from TRX XML files |
| tests/xharness/xharness.csproj | Links the new ParseTrxFile.cs into the xharness project |
| tests/xharness/Jenkins/Reports/MarkdownReportWriter.cs | Integrates TRX parsing to display up to 3 failing unit tests in markdown reports with a Cap string extension method |
| scripts/create-windows-html-report/create-windows-html-report.csproj | Links ParseTrxFile.cs into the HTML report generator project |
| scripts/create-windows-html-report/create-windows-html-report.cs | Refactors to use TrxParser instead of inline XML parsing for cleaner code |
| tools/devops/automation/scripts/TestResults.psm1 | Updates PowerShell script to parse and include TRX results in test summaries |
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
✅ [CI Build #42c4cd9] Build passed (Build packages) ✅Pipeline on Agent |
✅ [PR Build #42c4cd9] Build passed (Detect API changes) ✅Pipeline on Agent |
✅ [CI Build #42c4cd9] Build passed (Build macOS tests) ✅Pipeline on Agent |
💻 [CI Build #42c4cd9] Tests on macOS X64 - Mac Sonoma (14) passed 💻✅ All tests on macOS X64 - Mac Sonoma (14) passed. Pipeline on Agent |
💻 [CI Build #42c4cd9] Tests on macOS M1 - Mac Monterey (12) passed 💻✅ All tests on macOS M1 - Mac Monterey (12) passed. Pipeline on Agent |
💻 [CI Build #42c4cd9] Tests on macOS M1 - Mac Ventura (13) passed 💻✅ All tests on macOS M1 - Mac Ventura (13) passed. Pipeline on Agent |
💻 [CI Build #42c4cd9] Tests on macOS arm64 - Mac Sequoia (15) passed 💻✅ All tests on macOS arm64 - Mac Sequoia (15) passed. Pipeline on Agent |
💻 [CI Build #42c4cd9] Tests on macOS arm64 - Mac Tahoe (26) passed 💻✅ All tests on macOS arm64 - Mac Tahoe (26) passed. Pipeline on Agent |
✅ API diff for current PR / commitNET (empty diffs)✅ API diff vs stableNET (empty diffs)ℹ️ Generator diffGenerator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes) Pipeline on Agent |
🔥 [CI Build #42c4cd9] Test results 🔥Test results❌ Tests failed on VSTS: test results 0 tests crashed, 1 tests failed, 116 tests passed. Failures❌ fsharp tests1 tests failed, 3 tests passed.Failed tests
Html Report (VSDrops) Download Successes✅ cecil: All 1 tests passed. Html Report (VSDrops) Download Pipeline on Agent |
No description provided.