Skip to content

ref(skills): retire sentry-setup-ai-monitoring into sentry-instrument #286

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
evanpurkhiser wants to merge 1 commit into
base: main
Choose a base branch
from
Open

ref(skills): retire sentry-setup-ai-monitoring into sentry-instrument #286

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion AGENTS.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,6 @@ Skills use YAML frontmatter with `allowed-tools` — this is required by Cursor
### Setup Skills
| Skill | Description |
|-------|-------------|
| `sentry-setup-ai-monitoring` | Instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI |
| `sentry-otel-exporter-setup` | Setup OTel Collector with Sentry Exporter |
| `sentry-span-streaming-js` | Migrate JavaScript SDK from transaction-based to streamed span delivery |
| `sentry-span-streaming-python` | Migrate Python SDK from transaction-based to streamed span delivery |
Expand Down
1 change: 0 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,6 @@ To build any target locally, run `src/plugins/<agent>/build.sh <output-dir>`

| Skill | What it does |
|-------|--------------|
| `sentry-setup-ai-monitoring` | Instrument OpenAI, Anthropic, LangChain, Vercel AI, Google GenAI |
| `sentry-otel-exporter-setup` | Configure OTel Collector with the Sentry exporter for multi-project routing |
| `sentry-create-alert` | Create alerts via the Sentry workflow engine API |
| `sentry-snapshots-cocoa` | Set up Sentry Snapshots for Apple/Cocoa projects |
Expand Down
1 change: 0 additions & 1 deletion src/SKILL_TREE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,5 +49,4 @@ Configure specific Sentry capabilities beyond basic SDK setup.
|---|---|
| Create Sentry alerts using the workflow engine API | [`sentry-create-alert`](skills/sentry-create-alert/SKILL.md) |

@sentry sentry Bot Jul 13, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bug: The PR removes the sentry-setup-ai-monitoring skill, but legacy skill files in skills-legacy/ still contain broken references to it and its deleted sampling.md guide.
Severity: MEDIUM

Suggested Fix

Update the files in the skills-legacy/ directory to remove or replace the references to the deleted sentry-setup-ai-monitoring skill and its associated sampling.md file. Either point them to the new, correct skill and documentation or remove the feature reference if it's no longer supported in the legacy context. Consider adding the skills-legacy/ directory to the build validation script to prevent future issues.

Prompt for AI Agent 
Review the code at the location below. A potential bug has been identified by an AI
agent. Verify if this is a real issue. If it is, propose a fix; if not, explain why it's
not valid.

Location: src/SKILL_TREE.md#L50

Potential issue: The pull request retires the `sentry-setup-ai-monitoring` skill but
fails to update references in several legacy skill files located in the `skills-legacy/`
directory. Specifically, files like `skills-legacy/sentry-node-sdk/SKILL.md` and
`skills-legacy/sentry-instrumentation-guide/SKILL.md` still direct users to load the
now-deleted skill. Additionally, multiple legacy `ai-monitoring.md` reference files
contain broken links to a deleted `sampling.md` guide. Because the build validation
script ignores the `skills-legacy/` directory, these broken references were not caught,
which will lead to user confusion, routing failures, and 404 errors for users accessing
this legacy documentation.

Also affects:

  • skills-legacy/sentry-python-sdk/references/ai-monitoring.md:312
  • skills-legacy/sentry-node-sdk/references/ai-monitoring.md:229
  • skills-legacy/sentry-nextjs-sdk/references/ai-monitoring.md:421
  • skills-legacy/sentry-nestjs-sdk/references/ai-monitoring.md:336
  • skills-legacy/sentry-node-sdk/SKILL.md:680
  • skills-legacy/sentry-instrumentation-guide/SKILL.md:125

Did we get this right? 👍 / 👎 to inform future reviews.

| Configure the OpenTelemetry Collector with Sentry Exporter for multi-project routing and automatic project creation | [`sentry-otel-exporter-setup`](skills/sentry-otel-exporter-setup/SKILL.md) |
| Setup Sentry AI Agent Monitoring in any project | [`sentry-setup-ai-monitoring`](skills/sentry-setup-ai-monitoring/SKILL.md) |
| Full Sentry Snapshots setup for Apple/Cocoa projects | [`sentry-snapshots-cocoa`](skills/sentry-snapshots-cocoa/SKILL.md) |
14 changes: 6 additions & 8 deletions src/skills/sentry-feature-setup/SKILL.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
name: sentry-feature-setup
description: Configure specific Sentry features beyond basic SDK setup. Use when asked to monitor AI/LLM calls, set up OpenTelemetry pipelines, create alerts and notifications, or set up Sentry Snapshots.
description: Configure specific Sentry features beyond basic SDK setup. Use when asked to set up OpenTelemetry pipelines, create alerts and notifications, or set up Sentry Snapshots.
license: Apache-2.0
role: router
---
Expand All @@ -9,28 +9,26 @@ role: router

# Sentry Feature Setup

Configure specific Sentry capabilities beyond basic SDK setup — AI monitoring, OpenTelemetry pipelines, alerts, and Sentry Snapshots. This page helps you find the right feature skill for your task.
Configure specific Sentry capabilities beyond basic SDK setup — OpenTelemetry pipelines, alerts, and Sentry Snapshots. This page helps you find the right feature skill for your task.

## Start Here — Read This Before Doing Anything

**Do not skip this section.** Do not assume which feature the user needs. Ask first.

1. If the user mentions **AI monitoring, LLM tracing, conversations, or instrumenting an AI SDK** (OpenAI, Anthropic, LangChain, Vercel AI, Google GenAI, Pydantic AI) → `sentry-setup-ai-monitoring`
2. If the user mentions **OpenTelemetry, OTel Collector, or multi-service telemetry routing** → `sentry-otel-exporter-setup`
3. If the user mentions **alerts, notifications, on-call, Slack/PagerDuty/Discord integration, or workflow rules** → `sentry-create-alert`
4. If the user mentions **Apple/Cocoa snapshot testing or Sentry Snapshots for Apple platforms** — SnapshotPreviews, Apple Snapshots, Cocoa snapshots, Xcode snapshot testing, Swift previews for Sentry Snapshots, iOS, macOS, tvOS, watchOS, or visionOS → `sentry-snapshots-cocoa`.
1. If the user mentions **OpenTelemetry, OTel Collector, or multi-service telemetry routing** → `sentry-otel-exporter-setup`
2. If the user mentions **alerts, notifications, on-call, Slack/PagerDuty/Discord integration, or workflow rules** → `sentry-create-alert`
3. If the user mentions **Apple/Cocoa snapshot testing or Sentry Snapshots for Apple platforms** — SnapshotPreviews, Apple Snapshots, Cocoa snapshots, Xcode snapshot testing, Swift previews for Sentry Snapshots, iOS, macOS, tvOS, watchOS, or visionOS → `sentry-snapshots-cocoa`.

When unclear, **ask the user** which feature they want to configure. Do not guess.

> Instrumenting a signal (tracing/spans, logging, metrics, span streaming, or deciding what to emit) is now part of the standalone `sentry-instrument` skill.
> Instrumenting a signal — tracing/spans, logging, metrics, AI/LLM monitoring, or deciding what to emit — is part of the standalone `sentry-instrument` skill.

---

## Feature Skills

| Feature | Skill |
|---|---|
| AI/LLM monitoring and conversations — instrument OpenAI, Anthropic, LangChain, Vercel AI, Google GenAI, Pydantic AI | [`sentry-setup-ai-monitoring`](../sentry-setup-ai-monitoring/SKILL.md) |
| Sentry Snapshots for Apple/Cocoa — upload Apple snapshot images to Sentry; prefer SnapshotPreviews when Swift previews exist | [`sentry-snapshots-cocoa`](../sentry-snapshots-cocoa/SKILL.md) |
| OpenTelemetry Collector with Sentry Exporter — multi-project routing, automatic project creation | [`sentry-otel-exporter-setup`](../sentry-otel-exporter-setup/SKILL.md) |
| Alerts via workflow engine API — email, Slack, PagerDuty, Discord | [`sentry-create-alert`](../sentry-create-alert/SKILL.md) |
Expand Down
Loading
Loading