Add python skills and test. by LarryOsterman · Pull Request #375 · microsoft/skills

LarryOsterman · 2026-07-10T22:49:52Z

Adds Python skill-effectiveness experiments, expands skill reference documentation, and updates the Vally test harness.

Changes:

Adds Python Vally experiments and standardizes test models.
Adds capability/non-hero references and lifecycle guidance.
Updates Vally/Rust graders, harness output capture, and CI checks.
Reviewed Changes

…mprovements to skill-experiments script

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

…et available from crates.io

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

Reducing confusion on vally scope notifications.

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

richardpark-msft

Still looking through it, but found some things worth addressing now.

richardpark-msft · 2026-07-15T00:43:41Z

        with:
          fetch-depth: 0

      - uses: actions/setup-node@v4


You can use the latest setup-node action here instead of v4. v6 (currently v6.5.0) has been stable for months; I'd stick with v6 rather than v7, which only just shipped. Apply this to move up a major version:

Suggested change

- uses: actions/setup-node@v4

- uses: actions/setup-node@v6

One thing to watch: since v5, setup-node auto-caches when package.json has a packageManager field. This step just does a global npm install, so it should be a non-issue, but set package-manager-cache: false if you see odd caching.

richardpark-msft · 2026-07-15T00:43:41Z

            fi
-          elif [ "${{ github.event_name }}" = "pull_request" ]; then
-            collect_from_changed_dirs "${{ github.event.pull_request.base.sha }}" "${{ github.sha }}" | sort -u > "$specs_file"
+          elif [ "${{ github.event_name }}" = "pull_request" ] || [ "${{ github.event_name }}" = "pull_request_target" ]; then


You didn't end up using pull_request_target, so you can probably just revert this line (and any other ones related to it).

richardpark-msft · 2026-07-15T00:43:41Z

+          echo "::notice::Running Vally evaluations for same-repo PR from ${{ github.event.pull_request.head.repo.full_name }}."
+
+      - name: Vally PR scope notice (cross-repo)
+        if: ${{ steps.specs.outputs.has_specs == 'true' && github.event_name == 'pull_request' && github.event.pull_request.head.repo.full_name != github.repository }}


I was going back and forth on this with copilot - the checks (for PR vs non-PR) are a bit noisy but apparently you can break it apart a bit, which I think would help. So your overall purpose (everybody gets linted) happens easily enough and eval is a bit more special, but now it's confined to it's own job.

jobs: lint: runs-on: ubuntu-latest # runs for everyone, no token steps: - uses: actions/checkout@v6 # resolve specs + schema-only lint eval: needs: lint runs-on: ubuntu-latest if: github.event_name != 'pull_request' || github.event.pull_request.head.repo.full_name == github.repository permissions: contents: read copilot-requests: write env: GH_TOKEN: ${{ github.token }} steps: - uses: actions/checkout@v6 # build grader plugin + run vally eval

richardpark-msft · 2026-07-15T00:43:41Z

+    [string]$SkillPattern = "*-py",
+
+    [Parameter(Mandatory = $false)]
+    [ValidateRange(1, 128)]


Please get me the 128 core machine...

richardpark-msft · 2026-07-15T00:43:41Z

@@ -0,0 +1 @@
+Error: Experiment config file not found: Q:\src\skills\tests\scenarios\agent-framework-azure-ai-py\skill_effectiveness_experiment.yaml


Is this file supposed to be checked in? Also, Q:\ is not universal....

richardpark-msft · 2026-07-15T00:43:41Z

@@ -0,0 +1,94 @@
+Running experiment 'azure-monitor-ingestion-py-skill-experiment'
+Output: Q:\src\skills\tests\scenarios\azure-monitor-ingestion-py\vally\vally-experiment-results\2026-06-30T23-35-17-490Z


Another one, not sure if this file should be checked in. Maybe do a scrub and then add in a .gitignore file?

richardpark-msft · 2026-07-15T00:43:41Z

+    $npmLoaderPath = $null
+    $loaderCandidates = @(
+        (Join-Path $copilotDir "node_modules\@github\copilot\npm-loader.js"),
+        "q:\.tools\.npm-global\node_modules\@github\copilot\npm-loader.js"


Might be worth doing a pass, making sure you don't have other paths hardcoded from your dev setup.

richardpark-msft · 2026-07-15T00:43:41Z

+        [bool]$EnableNodeLoaderFallback = $true
+    )
+
+    $copilotCommand = Get-Command copilot -ErrorAction SilentlyContinue


There's a lot of code in here trying to be accomodating to all sorts of scenarios around copilot, but it's probably okay to just say 'use the copilot in the path, and if it's not t here, then bail' and then you can delete a bunch of code.

LarryOsterman · 2026-07-15T17:35:02Z

This PR is being split into 5 smaller, independently reviewable PRs (all targeting main). Keeping #375 open until the splits are merged.

Add capability and non-hero references for Python skills #382 — Add capability and non-hero references for Python skills (135 files)
Add Vally skill-effectiveness experiments and Python test scenarios #383 — Add Vally skill-effectiveness experiments and Python test scenarios (178 files)
Standardize Rust Vally scenarios and remove azure-servicebus-rust #381 — Standardize Rust Vally scenarios and remove azure-servicebus-rust (39 files)
Vally harness and CI workflow updates #380 — Vally harness and CI workflow updates (9 files)
skill-creator: lifecycle guidance and Azure SDK patterns reference #379 — skill-creator: lifecycle guidance and Azure SDK patterns reference (2 files)

Together these cover all 361 changed files in this PR, with no overlap.

* Add capability and non-hero references for Python skills Split from #375: adds references/capabilities.md and references/non-hero-scenarios.md across ~30 azure-sdk-python skills, updates their SKILL.md files, and refreshes .github/skills symlinks. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e * Fix create_analyzer to begin_create_analyzer LRO in contentunderstanding non-hero-scenarios * Fix get_supported_languages to use TextTranslationClient in translation-document non-hero-scenarios * Clarify TextTranslationClient default endpoint in supported languages example * Fix instrumentation_options API and supported libraries in azure-monitor-opentelemetry-py non-hero-scenarios * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Apply remaining changes * Fix invalid token acquisition example in m365 capabilities reference * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Replace placeholder non-hero scenario files with actionable content Add retry, timeout, pagination, cleanup, and async examples for: - azure-ai-transcription-py - azure-messaging-webpubsubservice-py - azure-ai-language-conversations-py * Fix variable naming and list iteration in new non-hero scenarios * Replace Azure SDK boilerplate checklist with Pydantic-specific checks in capabilities.md * Refine Pydantic checklist: focus v2 patterns item on new code * Fix fastapi-router-py capabilities checklist: replace Azure SDK boilerplate with FastAPI-specific checks * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Fix remaining open review comments: eventgrid event var, transcription/speech auth, fabric RpSku, keyvault/botservice credential exposure * Fix Authorization header wording in speech-to-text-rest SKILL.md * Polish wording per code review: fabric None guard, transcription key comment, speech-to-text auth reference * Address all open PR review comments - Fix pnpm-workspace.yaml: resolve esbuild allowBuilds placeholder - Fix azure-mgmt-apicenter non-hero: add missing closing parenthesis - Fix azure-monitor-opentelemetry SKILL.md: flush() → force_flush() - Fix azure-monitor-opentelemetry-exporter SKILL.md: flush() → force_flush() - Fix azure-storage-queue non-hero: re-raise instead of silently passing exception - Fix azure-identity non-hero: log and re-raise auth errors instead of silently passing - Fix azure-ai-contentunderstanding non-hero: AnalysisInput → AnalyzeInput, fix model imports - Fix azure-ai-transcription SKILL.md + non-hero: use AzureKeyCredential wrapper - Fix m365-agents capabilities.md: complete CopilotClient example end-to-end * Polish m365-agents capabilities: improve variable names and context manager comment * Fix remaining review comments and CI pipeline failure - Delete tests/pnpm-workspace.yaml (caused CI 'packages field missing' error) - Delete azure-cosmos-py/scripts/setup_cosmos_container.py (outside PR scope) - Fix pydantic-models-py: clarify model_validate vs direct construction - Fix m365-agents-py: remove activity.conversation.id (UnboundLocalError on empty stream) - Fix azure-messaging-webpubsubservice-py: use close_user_connections, don't log bearer token URL - Fix azure-messaging-webpubsubservice-py acceptance-criteria: update connection close example - Fix azure-ai-transcription-py: correct LROPoller timeout pattern (done()+deadline loop) - Fix azure-ai-transcription-py acceptance-criteria: remove DefaultAzureCredential anti-pattern - Fix azure-ai-translation-text-py: use InputTextItem instead of raw strings in all bodies - Fix azure-ai-ml-py: remove unused Pipeline import - Fix azure-ai-language-conversations-py: fix orchestration intents (dict keyed by name) * Move import time to top of transcription timeout example * Fix transcription acceptance criteria: add DefaultAzureCredential as valid auth, remove incorrect anti-pattern --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Update Vally test harness and CI workflows Split from #375: harness output capture and runner updates, new copilot-client tests, and CI workflow updates (rename vally-evaluation to run-vally-evaluations, test-harness tweaks, actions-lock). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e * Add missing .github/skills symlinks for azure-sdk-python plugin * fix: address workflow review suggestions --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

) * Add lifecycle guidance and Azure SDK patterns to skill-creator Split from #375: updates skill-creator SKILL.md with skill lifecycle guidance and adds references/azure-sdk-patterns.md. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * skill-creator: remove sync/async preference from guidance Azure SDK guidance should not express a preference for either sync or async clients. Updated SKILL.md and azure-sdk-patterns.md to present both forms as first-class options with equal priority, removing the "pick one mode" directives while retaining the rule against mixing sync and async within a single call path. * skill-creator: replace inaccurate benchmark skill descriptions The previous benchmark table referenced azure-ai-ml-py and other Python skills with descriptions that didn't match their actual content (e.g., azure-ai-ml-py covers workspaces/data/models/compute/jobs/pipelines, not a single train+register workflow). Replace with verified Rust skills from this repository that actually demonstrate the one-workflow/1-2-example criteria. Also drop the misleading 'Tokens Δ' column which implied historical optimization comparisons not applicable to new skills. * skill-creator: fix remaining review issues from f2d1873 review * skill-creator: resolve outstanding review comments * skill-creator: resolve remaining PR review comments * skill-creator: fix remaining review guidance issues * Apply remaining changes * fix: restore valid pnpm workspace config for tests * Address latest PR review feedback * fix: resolve latest skill-creator review feedback --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

* Standardize Rust Vally scenarios and remove azure-servicebus-rust Split from #375: restandardizes Rust scenario eval files (adds eval.yaml and skill_effectiveness_eval.yaml, removes older eval-experiment/nobuild variants), updates shared Rust experiment config and cargo-build-failure grader plugin, and removes the azure-servicebus-rust skill and scenarios. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e * Fix Rust Vally review feedback in PR #381 * Fix CI: update pnpm-lock.yaml and add pnpm-workspace.yaml for @microsoft/vally ^0.9.0 * fix: resolve nested plugin sub-skill directories in harness * fix: add packages entry to tests pnpm workspace * fix: align vally workflow CLI with 0.9 metadata * Use vally version 0.10.0 * Fix review comments for workflow and nested skill tests * fix review comments from review 4749328063 * Rename grader_model to judge_model in Vally eval defaults for Rust scenarios --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

…383) * Add Vally skill-effectiveness experiments and Python test scenarios Split from #375: adds the Vally skill-effectiveness experiment framework (run-skill-experiments.ps1, run-all-evals.ps1, generate-skill-experiments.ps1, compare-experiment.mjs), standardized vally eval/experiment yaml and scenarios.yaml for ~40 Python skills, shared Python grader tooling, and harness runner script/dependency updates. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e * Update vally version * Update package info * Fix review comments: delete artifact, fix exception handling, add exclude-pattern support * Fix review 4708288806 comments: exceptions, duplicate files, tab check, PS1 fixes * Removed experiment specific evaluations; cleaned up existing eval.yaml files * Removed bogus files * test: cover python static graders * fix: address all 10 comments from review 4739490318 * fix: rename grader_model to judge_model in all Python eval specs (Vally 0.10) * Improved reliability of prompts * Fixed test harness for azure-appconfiguration-py skill * Fix --junit output path and update Node.js version prerequisite * Fix fastapi-router-py template.py to use {{}} placeholder syntax * fix: update Node.js version to 22 in test-harness workflow * fix: skip template Python files containing {{...}} placeholders in syntax check * fix: remove invalid 'execution' and 'portability' fields from GraderMetadata * fix: allow esbuild builds in tests workspace * fix: restore required vally grader metadata * fix: remove obsolete execution and portability fields from rust-cargo-build-failure grader * Fix remaining review thread feedback * Fixes from rust branch * Apply remaining changes * Fix grader metadata typing * Remove test-harness.yml workflow (belongs to PR #380) * Fix remaining review thread feedback * Restore test-harness.yml deleted in error The file was removed on this split branch under the assumption it belonged only to PR #380, but #380 already merged it into main unchanged. Since the merge-base copy matched main, merging this branch would have deleted the file from main. Restoring it to main's version so this branch carries it through untouched. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> * Add @microsoft/vally-cli to test devDependencies and update lockfile * Fix Windows-only backslashes and README pnpm --dir path - tests/run-all-evals.ps1: Replace backslashes with forward slashes in customGraderPluginDir, customGraderDistEntry, and vallyCmd paths so that Join-Path resolves them correctly on Linux/macOS. - tests/scenarios/README.md: Fix 'pnpm --dir ../../../..' (repository root) to 'pnpm --dir ../../..' (tests/) and update the experiment file and output-dir paths to be relative to tests/. * Move Vally expect_skills constraints into each stimulus * Fix azure-eventhub-rust review feedback * Fix remaining fastapi and eval review issues * Updated timeouts on skills * Fix review 4766529446: experiment evals, vally probe, timestamps, dead params, version gate * Removed skill_effectiveness_eval.yaml files for python * Repoint python skill experiments to eval.yaml and remove generator script Completes 27ae1ab: the eval.yaml deletions were committed but the experiment repoints (skill_effectiveness_eval.yaml -> eval.yaml) and the generate-skill-experiments.ps1 deletion were left unstaged, so git status kept showing them. Commit them so the python experiments reference the single general-purpose eval.yaml. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: 82323067-0922-476e-8f08-4659317988ab * Regenerate rust skills and add guidance on structures. * Fix 5 issues from review 4768872057: pnpm-workspace bool, cargo clippy -D warnings, compare-experiment score check, run-skill-experiments local vally, README pylint install step * Cleaned up eval job; simplified storage skills somewhat * Fix azure-mgmt-apimanagement-py: remove invalid require_envvar from DefaultAzureCredential * Fix cargo clippy --D warnings in Rust eval files and fix -rs typo in run-skill-experiments.ps1 * Fix pydantic-models-py: simplify template to prevent file truncation in evals The base_create_response_indb stimulus was failing Python syntax and idiomatic checks because the LLM generated oversized Python files (with helpers and section comments) that got truncated during writing. Changes: - Reduce template.py from 124 to 48 lines using concise ConfigDict pattern, inline Field calls, and brief docstrings - Update SKILL.md examples to use ConfigDict (modern Pydantic v2) - Remove verbose section separators and boilerplate comments * Fix pydantic vally camel_case_aliases workspace output path * Fix vally CI: add file save instructions and improve error handling examples - pydantic-models-py eval: add file save instruction to base_create_response_indb prompt so agents write a .py file, fixing "No Python files found" grader failure - azure-ai-translation-document-py eval: add file save instructions to both stimuli for deterministic grader behavior - azure-ai-translation-document-py skill: rewrite Basic Document Translation section with complete self-contained example including try/except HttpResponseError; remove invalid require_envvar=True parameter from DefaultAzureCredential() * Fix review 4790830267: add file save instructions and fix eval output key collision - Thread 97: Add 'Save the code to <file>.py in the current workspace.' to all eval stimuli that use Python graders but lacked explicit file output paths, preventing deterministic grader failures when models respond without saving files. Affected: agent-framework-azure-ai-py, azure-ai-contentsafety-py, azure-ai-contentunderstanding-py, azure-ai-ml-py, azure-ai-projects-py, azure-ai-textanalytics-py, azure-ai-transcription-py, azure-ai-translation-text-py, azure-ai-vision-imageanalysis-py, azure-ai-voicelive-py, azure-containerregistry-py, azure-cosmos-db-py, fastapi-router-py, m365-agents-py, azure-storage-queue-py - Thread 98: Include eval filename in output key in run-all-evals.ps1 so that eval.yaml and skill_effectiveness_eval.yaml in the same vally/ folder write to separate output directories, preventing JUnit file and run-dir lookup collisions * Removed experimental files that are no longer needed * fix: add #Requires -Version 7.0 to run-all-evals.ps1 (review 4739841645) * Fix 6 issues from review 4791599641: workspace file requirements and producer open() &str fix * Fix all review #4791806947 comments: syntax checks, compare-experiment, package/workflow versions, dead params, exit code tracking * Fix azure-ai-projects-py: wrong import paths and invalid credential parameter * Fix review 4791806947: add save instructions to eval.yaml stimuli, fix blob-rust ignore_for_fail, fix skill-creator Rust guidance - Add 'Save the code to file.py' instructions to all eval.yaml stimuli missing them (31 stimuli across 18 Python scenario files) so the workspace-only syntax/pylint graders can find the .py files - Remove error_exceptions from Post-prompt graders in azure-storage-blob-rust/vally/eval.yaml (keep only on trajectory analysis), preventing genuine E0277 compilation failures from being masked as successful builds - Fix #[non_exhaustive] guidance in skill-creator/SKILL.md: distinguish between externally constructible structs (use ..Default::default()) and truly non_exhaustive structs (use constructor/builder or default-then-mutate) to avoid E0639 compile errors * Fix azure-monitor-opentelemetry-py: add explicit connection_string example, fix invalid credential param - Replace "Explicit Configuration" section with "Explicit Connection String" section showing connection_string=os.environ["APPLICATIONINSIGHTS_CONNECTION_STRING"] with try/except - Remove invalid DefaultAzureCredential(require_envvar=True) parameter (not a valid API) - Update capabilities.md to reflect renamed section This fixes the azure-monitor-opentelemetry-py-eval explicit_connection_string scenario which was failing Python syntax and idiomatic checks because the skill lacked a canonical example for the connection_string parameter pattern. * Fix --junit flag, add datetime import, add rust grader plugin support in experiments - run-all-evals.ps1: Remove filename arg from --junit flag; Vally 0.10 treats it as boolean - pydantic-models-py/SKILL.md: Add missing 'from datetime import datetime' import in camelCase Aliases example - run-skill-experiments.ps1: Mirror rust-cargo-build-failure grader plugin detection/build/pass from run-all-evals.ps1 --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Copilot-Session: 9429ad33-6f31-4ec5-ba00-0f11b5afb82e Copilot-Session: 82323067-0922-476e-8f08-4659317988ab

LarryOsterman added 30 commits June 26, 2026 13:53

Ensure that python scenarios pass with current models

445df74

Updated python skills; added skills links

a71fe6c

Added initial evaluations for all python skills

b103ad9

Updated vally evaluations and verified functionality

c38e89a

Added vally experiments for all the python skills

4441d58

Updated skill generator to improve compactness of skills

234315e

Update rust evaluations to give tools more time to run; significant i…

2c5195e

…mprovements to skill-experiments script

Updated node version to current

95a59b4

Added rust toolchain install for rust evals

34655a4

CI pipeline and build fixes

adc50d0

Neuter vally evaluations for now

b053b67

CI pipeline possible fix

2800214

CI pipeline possible fix

d972fc7

Just try out copilot cli before doing expensive stuff

cb7adf9

Install copilot

c3c0bd6

And set the environment variable

6f35944

Updated evaluations

ff4da64

Restored older ealuations

5bdc963

Moved back to agentic workflow; update to vally 0.7.0

3335acd

Moved back to agentic workflow; update to vally 0.7.0

9fc75a9

enable copilot-requests permission

8e39594

enable copilot-requests permission again

1883683

Fixed lockfile

7286a99

Added lockfile explicitly

0cf1bb0

CI fixes

3ca00fb

For ce update to prompt

4772426

Try defining a token for vally to use

8c45247

Added back evaluation workflow separate from agentic workflow

a312f96

Try pull_request_target

dc4a46b

Oops, wrong evaluation

d79c98f

LarryOsterman marked this pull request as ready for review July 13, 2026 23:30

LarryOsterman requested a review from thegovind as a code owner July 13, 2026 23:30

Copilot AI review requested due to automatic review settings July 13, 2026 23:30

LarryOsterman requested a review from g2vinay as a code owner July 13, 2026 23:30

Copilot started reviewing on behalf of LarryOsterman July 13, 2026 23:31 View session

Copilot AI reviewed Jul 13, 2026

Removed azure-servicebus-rust skills because rust servicebus is not y…

f1c7d90

…et available from crates.io

Copilot AI review requested due to automatic review settings July 14, 2026 00:28

Copilot started reviewing on behalf of LarryOsterman July 14, 2026 00:29 View session

Copilot AI reviewed Jul 14, 2026

LarryOsterman requested a review from a team July 14, 2026 21:33

Clarify PR scope evaluation notice

41cf7de

Reducing confusion on vally scope notifications.

Copilot AI review requested due to automatic review settings July 14, 2026 22:00

Copilot started reviewing on behalf of LarryOsterman July 14, 2026 22:01 View session

Copilot AI reviewed Jul 14, 2026

richardpark-msft reviewed Jul 15, 2026

View reviewed changes

LarryOsterman marked this pull request as draft July 15, 2026 17:15

LarryOsterman closed this Jul 28, 2026

LarryOsterman deleted the larryo/python_skills branch July 28, 2026 23:00

		@@ -0,0 +1 @@
		Error: Experiment config file not found: Q:\src\skills\tests\scenarios\agent-framework-azure-ai-py\skill_effectiveness_experiment.yaml

		@@ -0,0 +1,94 @@
		Running experiment 'azure-monitor-ingestion-py-skill-experiment'
		Output: Q:\src\skills\tests\scenarios\azure-monitor-ingestion-py\vally\vally-experiment-results\2026-06-30T23-35-17-490Z

Uh oh!

Conversation

LarryOsterman commented Jul 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

richardpark-msft left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

LarryOsterman commented Jul 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

LarryOsterman commented Jul 10, 2026 •

edited

Loading