eval: skill comparison script - #3070

Merged

JasonYeMSFT (JasonYeMSFT) merged 22 commits into

mainfrom

chuye/no-skill-compare-2

Aug 19, 2026

Commits on Aug 11, 2026

test compare script
JasonYeMSFT (JasonYeMSFT)
committed
b8eb58c
tweak input and output format
JasonYeMSFT (JasonYeMSFT)
committed
dfc5835
analyze-comparison-tests skill
JasonYeMSFT (JasonYeMSFT)
committed
c71556c
use input for azure-resource-lookup
JasonYeMSFT (JasonYeMSFT)
committed
5291e8f
update sample output to match sample input
JasonYeMSFT (JasonYeMSFT)
committed
d148627
fix compare script for boolean input
JasonYeMSFT (JasonYeMSFT)
committed
0d4dc2c
update artifacts layout in analyze-comparison-tests skill
JasonYeMSFT (JasonYeMSFT)
committed
aa0cc30
rewrite collect-artifacts script in TS
JasonYeMSFT (JasonYeMSFT)
committed
3df58d3
azure-resource-lookup comparison report
JasonYeMSFT (JasonYeMSFT)
committed
c039c89
sample per stimuli comparison reports
JasonYeMSFT (JasonYeMSFT)
committed
e19e18c

Commits on Aug 14, 2026

move files to comparison folder
JasonYeMSFT (JasonYeMSFT)
committed
1e9ce2d
compare against different branches
JasonYeMSFT (JasonYeMSFT)
committed
de608c7
update shortcut command
JasonYeMSFT (JasonYeMSFT)
committed
6d5a5b4
delete temporary files
JasonYeMSFT (JasonYeMSFT)
committed
26a971a
revert test change
JasonYeMSFT (JasonYeMSFT)
committed
adb424c
update analyze-comparison-tests skill
JasonYeMSFT (JasonYeMSFT)
committed
f5aeda8

Commits on Aug 18, 2026

delete sample files
JasonYeMSFT (JasonYeMSFT)
committed
abc194e
uncomment all models in default comparison config
JasonYeMSFT (JasonYeMSFT)
committed
875eaa9
fix lint
JasonYeMSFT (JasonYeMSFT)
committed
227b620
address copilot feedback
JasonYeMSFT (JasonYeMSFT)
committed
dc622f8
execSync -> execFileSync
JasonYeMSFT (JasonYeMSFT)
committed
8c93dd1
Potential fix for pull request finding

JasonYeMSFT (JasonYeMSFT)
and
Copilot
authored
c8ed45c