Skip to content

Add audit-sdk-docs skill and fix outdated doc references#48114

Draft
msyyc wants to merge 3 commits into
Azure:mainfrom
msyyc:msyyc/add-audit-sdk-docs-skill
Draft

Add audit-sdk-docs skill and fix outdated doc references#48114
msyyc wants to merge 3 commits into
Azure:mainfrom
msyyc:msyyc/add-audit-sdk-docs-skill

Conversation

@msyyc

@msyyc msyyc commented Jul 17, 2026

Copy link
Copy Markdown
Member

Summary

An agent-maintained, self-improving skill to keep repo docs and code annotations accurate, current, and non-redundant, so agents get the right info from the repo. Relates to #48112. Includes two doc fixes the skill surfaced.

New skill: .github/skills/audit-sdk-docs

Audits across four dimensions (each run as a small, judged batch):

  1. Stale references (automated) - broken relative links, dead in-repo GitHub URLs, missing inline path refs. Read-only scanner scripts/check_outdated_docs.py (excludes sdk/, eng/common*, node_modules).
  2. Annotation vs code drift - docstrings/comments/CLI-help/type claims that no longer match the real code.
  3. Duplicated or contradictory docs - same concept documented in multiple diverging places -> consolidate to a single source of truth / fix the authoritative value.
  4. Simplification - remove dead sections, collapse duplication, tighten wording without dropping information.

Self-improving: the mandatory last step reviews the process and folds any reusable pattern/solution back into the skill, committed in the same PR.

Doc fixes found by the skill (Dimension 1)

  • doc/dev/conda-builds.md: eng/conda_env.yml -> conda/conda-recipes/conda_env.yml (moved in Refactor Conda Pipeline #31804; verified via conda_functions.py get_version_from_config).
  • doc/dev/mgmt/tests.md: sample conftest.py link repointed from the removed sdk/advisor/azure-mgmt-advisor/tests/ to sdk/apimanagement/azure-mgmt-apimanagement/tests/conftest.py.

Follow-ups (left for a separate batch)

  • eng/tools/azure-sdk-tools/README.md references missing scripts/devops_tasks/build_packages.py (likely moved).

Draft PR for review of the approach.

Adds an agent-maintained skill (.github/skills/audit-sdk-docs) that scans
repo Markdown/rST docs for outdated references (broken relative links, dead
in-repo GitHub URLs, missing inline path refs), excluding the auto-generated
sdk/ tree and centrally-synced eng/common. Also fixes two stale references
found by the scanner:

- doc/dev/conda-builds.md: eng/conda_env.yml -> conda/conda-recipes/conda_env.yml
- doc/dev/mgmt/tests.md: sample conftest.py link repointed to an existing package

Relates to Azure#48112

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3971b453-9687-459a-b084-b4b4697f6caa
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
9 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

msyyc and others added 2 commits July 17, 2026 16:55
…, self-improve

Adds three audit dimensions beyond stale references:
- annotation vs code drift (docstrings/comments match real code)
- duplicated or contradictory docs about the same concept
- doc simplification

Also makes the skill self-improving: the mandatory last step reviews the
process and folds any reusable pattern/solution back into the skill, committed
in the same PR.

Relates to Azure#48112

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3971b453-9687-459a-b084-b4b4697f6caa
Dimension 3/4: doc/dev/conda-builds.md CI Build Process bullets duplicated and
partly contradicted the authoritative, now-automated process in conda-release.md.
Consolidated to a single-source-of-truth pointer; this page stays focused on
local builds.

Self-improve (skill Step 6): record the reusable finding that a MISSING_PATH_REF
introduced with "Previously in"/"formerly"/"moved from" is intentional history
and must be left alone, plus this run's example findings.

Relates to Azure#48112

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3971b453-9687-459a-b084-b4b4697f6caa
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant