Build an agent that streamlines partner onboarding

[yunjchoi]

Context

Today, onboarding a new partner plugin/skill is a manual, high-touch process (repo structure, evals, validation, version-stamping, sync, marketplace registration, docs). This agent should guide a partner from "I have a skill idea" to "my plugin is published and passing checks" with minimal hand-holding from the Azure Skills team.

Scope

1. Scaffold a compliant plugin: correct  plugins//  and  evals/  layout, metadata, and manifest.
2. Detect the onboarding path (core plugin vs. new plugin) and follow the right process.
3. Wire tests: generate per-skill eval suites and register the plugin with the test/CI workflows.
4. Run & interpret validation: invoke local validation + integration/routing tests, summarize failures, and suggest fixes.
5. Prepare release: apply version-stamping, register in the marketplace config, and set up the sync workflow.
6. Verify install/update UX for the new plugin before publish.
7. Produce a checklist/status report of what's done, blocked, or pending human sign-off.

Acceptance criteria

• A partner can onboard a sample plugin end-to-end via the agent without direct core-team intervention for the happy path.

[github-actions]

Thanks for opening this, @yunjchoi! 🎉

This has been triaged as a Feature with Medium priority — it's a meaningful improvement for the multi-plugin initiative with clear partner impact. Labels azure-prepare and azure-validate were applied to reflect the scaffolding and validation scope, along with partner and skills for discoverability. This is a solid, well-scoped feature request and a great candidate for a coding agent to build out — the acceptance criteria and scope make it actionable.

Generated by Issue Triage for #2804 · 30.9 AIC · ⌖ 6.49 AIC · ⊞ 5.5K · ◷