Skip to content

chore: update model-to-API mapping (2026-07-02)#5804

Merged
lpcox merged 2 commits into
mainfrom
chore/update-model-api-mapping-2026-07-02-0b50c284bee968a4
Jul 2, 2026
Merged

chore: update model-to-API mapping (2026-07-02)#5804
lpcox merged 2 commits into
mainfrom
chore/update-model-api-mapping-2026-07-02-0b50c284bee968a4

Conversation

@github-actions

@github-actions github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Summary

Updates docs/model-api-mapping.json based on the official OpenAI OpenAPI specification (openai/openai-openapi), specifically the ModelIdsShared and ResponsesOnlyModel schemas.

Changes

Six OpenAI model families had incorrect endpoint assignments (marked responses-only when they actually support both endpoints):

Family Before After Source
gpt-5.4* responses chat_completions, responses ModelIdsShared
gpt-5.3* responses chat_completions, responses ModelIdsShared
gpt-5.2* responses chat_completions, responses ModelIdsShared
gpt-5.1* responses chat_completions, responses ModelIdsShared
gpt-5 / gpt-5-* responses chat_completions, responses ModelIdsShared
o4* responses chat_completions, responses ModelIdsShared

Notes fixes

  • gpt-5.1: Removed non-existent gpt-5.1-codex-mini; clarified that gpt-5.1-codex-max is the ResponsesOnlyModel variant.
  • gpt-5.3: Removed unconfirmed codex variants; only gpt-5.3-chat-latest exists in the OpenAPI spec.
  • gpt-5: Clarified that gpt-5-codex and gpt-5-pro are ResponsesOnlyModel; base/mini/nano support both.
  • o4: Clarified that o4-mini supports both; o4-mini-deep-research is ResponsesOnlyModel.
  • gpt-4.1: Added confirmed sub-models (mini, nano).

Anthropic

No changes needed — current entries match the Anthropic docs (claude-fable-5, claude-opus-4-8, claude-sonnet-5, claude-haiku-4-5, claude-mythos-5 all confirmed).

Source

https://raw.githubusercontent.com/openai/openai-openapi/master/openapi.yamlModelIdsShared and ResponsesOnlyModel component schemas.

Warning

Firewall blocked 3 domains

The following domains were blocked by the firewall during workflow execution:

  • awmgmcpg
  • developers.openai.com
  • openai.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"
    - "developers.openai.com"
    - "openai.com"

See Network Configuration for more information.

Generated by 🗺️ Model API Mapping Updater · 172.7 AIC · ⌖ 9.94 AIC · ⊞ 5K ·

- Fix endpoint support for gpt-5.4, gpt-5.3, gpt-5.2, gpt-5.1: all are in
  ModelIdsShared (OpenAI OpenAPI spec), meaning they support both
  /v1/chat/completions and /v1/responses (not responses-only as before).
- Fix o4 family: o4-mini is in ModelIdsShared (both endpoints); only
  o4-mini-deep-research is ResponsesOnlyModel.
- Fix gpt-5 family: gpt-5/mini/nano support both endpoints; gpt-5-codex and
  gpt-5-pro are ResponsesOnlyModel.
- Fix gpt-5.1 notes: remove non-existent gpt-5.1-codex-mini; gpt-5.1-codex-max
  is the real ResponsesOnlyModel variant.
- Fix gpt-5.3 notes: remove unconfirmed codex variants; only gpt-5.3-chat-latest
  exists in the OpenAPI spec.
- Enrich gpt-4.1 notes with confirmed sub-models (mini, nano).
- Source: openai/openai-openapi ModelIdsShared + ResponsesOnlyModel schemas.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@lpcox lpcox marked this pull request as ready for review July 2, 2026 22:33
Copilot AI review requested due to automatic review settings July 2, 2026 22:33

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the OpenAI portion of the model→endpoint reference map used to decide whether a model should be called via /v1/chat/completions, /v1/responses, or both.

Changes:

  • Bumped lastUpdated timestamp.
  • Reassigned several OpenAI model families (gpt-5.x, o4) from responses-only to chat_completions + responses.
  • Expanded/clarified notes for certain families (e.g., gpt-4.1 sub-models).
Show a summary per file
File Description
docs/model-api-mapping.json Updates OpenAI model family endpoint support and refresh timestamp.

Review details

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 1/1 changed files
  • Comments generated: 4
  • Review effort level: Low

Comment thread docs/model-api-mapping.json Outdated
"title": "Model-to-API Endpoint Mapping",
"description": "Maps AI model families to their supported API endpoints. Used to determine which endpoint (chat/completions vs responses vs messages) a model requires.",
"lastUpdated": "2026-07-01T08:18:06Z",
"lastUpdated": "2026-07-02T07:56:20Z",
Comment thread docs/model-api-mapping.json Outdated
Comment on lines +47 to +50
"family": "gpt-5.1",
"patterns": ["gpt-5.1*"],
"endpoints": ["responses"],
"notes": "Responses API only. Includes gpt-5.1-codex, gpt-5.1-codex-max, gpt-5.1-codex-mini variants."
"endpoints": ["chat_completions", "responses"],
"notes": "Supports both endpoints for gpt-5.1, gpt-5.1-codex, gpt-5.1-mini. gpt-5.1-codex-max is Responses API only (ResponsesOnlyModel)."
Comment thread docs/model-api-mapping.json Outdated
Comment on lines +53 to +56
"family": "gpt-5",
"patterns": ["gpt-5", "gpt-5-*"],
"endpoints": ["responses"],
"notes": "Responses API only. Includes gpt-5-mini, gpt-5-nano, gpt-5-pro."
"endpoints": ["chat_completions", "responses"],
"notes": "Supports both endpoints for gpt-5, gpt-5-mini, gpt-5-nano. Responses API only for gpt-5-codex and gpt-5-pro (ResponsesOnlyModel)."
Comment thread docs/model-api-mapping.json Outdated
Comment on lines +59 to +62
"family": "o4",
"patterns": ["o4*"],
"endpoints": ["responses"],
"notes": "Reasoning model. Responses API only. Includes o4-mini."
"endpoints": ["chat_completions", "responses"],
"notes": "Reasoning model. o4-mini supports both endpoints (ModelIdsShared). o4-mini-deep-research is Responses API only."
@lpcox

lpcox commented Jul 2, 2026

Copy link
Copy Markdown
Collaborator

@copilot address review feedback

Copilot AI commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

@copilot address review feedback

Addressed in 4389198.

  • Synced /reflect mapping source by updating containers/api-proxy/model-api-mapping.json to match docs/model-api-mapping.json (including lastUpdated).
  • Fixed first-match wildcard conflicts by adding explicit responses-only entries before broad patterns for gpt-5.1-codex-max, gpt-5-codex/gpt-5-pro, and o4-mini-deep-research.
  • Updated containers/api-proxy/model-api-mapping.test.js to cover the corrected precedence and updated reflect timestamp.

Copilot AI requested a review from lpcox July 2, 2026 22:50
Copilot finished work on behalf of lpcox July 2, 2026 22:50
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

✅ Copilot review passed with no inline comments.

@github-actions[bot] Add the ready-for-aw label to this PR to trigger agentic CI smoke tests.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Security Guard failed. Please review the logs for details.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Documentation Preview

Documentation build failed for this PR. View logs.

Built from commit 03f8572

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Chroot tests failed Smoke Chroot failed - See logs for details.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Gemini completed. All facets verified. 💎

Smoke test completed with partial failures. Comment added to PR #5804.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🔌 Smoke Services — All services reachable! ✅

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Build Test Suite completed successfully!

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Claude passed

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Copilot BYOK AOAI (api-key) completed. Copilot AOAI BYOK (api-key) mode operational. 🔓

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

📡 Smoke OTel Tracing completed. All tracing scenarios validated. ✅

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Copilot BYOK AOAI (Entra) completed. Copilot AOAI BYOK (Entra) mode operational. 🔓

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🔑 Smoke Copilot PAT PAT auth validated. All systems operational. ✅

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Copilot BYOK completed. Copilot BYOK mode operational. 🔓

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Contribution Check completed successfully!

PR #5804 follows the applicable CONTRIBUTING.md guidelines based on the provided context: it has a clear description, updates documentation/data, includes relevant tests, and keeps files in appropriate locations.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

⚠️ Coverage Regression Detected

This PR decreases test coverage. Please add tests to maintain coverage levels.

Overall Coverage

Metric Base PR Delta
Lines 98.64% 98.66% 📈 +0.02%
Statements 98.53% 98.55% 📈 +0.02%
Functions 99.56% 99.56% ➡️ +0.00%
Branches 94.51% 94.42% 📉 -0.09%
📁 Per-file Coverage Changes (2 files)
File Lines (Before → After) Statements (Before → After)
src/container-stop.ts 100.0% → 95.7% (-4.35%) 100.0% → 95.7% (-4.35%)
src/workdir-setup.ts 93.0% → 94.8% (+1.74%) 93.0% → 94.8% (+1.74%)

Coverage comparison generated by scripts/ci/compare-coverage.ts

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Test: Claude Engine Validation

Check Result
API Status ✅ PASS
GH Check ✅ PASS
File Status ✅ PASS

Overall Result: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by Smoke Claude for #5804 · 54.4 AIC · ⊞ 3.3K ·
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

@lpcox

  • ${{ steps.smoke-data.outputs.SMOKE_PR_DATA }}
  • HTTP 200 ✅
  • File I/O ✅
  • Direct BYOK mode via api-proxy → Azure OpenAI (o4-mini-aw) ✅

PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

🔑 BYOK (AOAI api-key) report filed by Smoke Copilot BYOK AOAI (api-key)
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

@lpcox

GitHub MCP Testing: ✅
GitHub.com Connectivity: ✅
File Write/Read Test: ✅
BYOK Inference Test: ✅

Running in direct BYOK mode (AWF_AUTH_TYPE=github-oidc + AWF_AUTH_AZURE_* + COPILOT_PROVIDER_BASE_URL) via api-proxy → Azure OpenAI (Foundry, o4-mini-aw) authenticated via Microsoft Entra

Overall: PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

🪪 BYOK (AOAI Entra) report filed by Smoke Copilot BYOK AOAI (Entra)
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Test: GitHub Actions Services Connectivity

  • Redis PING: ❌ Network is unreachable
  • PostgreSQL pg_isready: ❌ No response
  • PostgreSQL SELECT 1: ❌ Network is unreachable

Overall: FAILhost.docker.internal (172.17.0.1) is not reachable from this environment.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

🔌 Service connectivity validated by Smoke Services
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🔬 Smoke Test Results

Test Status
GitHub.com connectivity (HTTP 200)
GitHub MCP connectivity
File write/read ❌ (template vars unresolved)

Overall: FAIL — workflow template variables (${{ steps.smoke-data.outputs.* }}) were not substituted.

cc @lpcox

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

📰 BREAKING: Report filed by Smoke Copilot
Add label ready-for-aw to run again

@github-actions github-actions Bot mentioned this pull request Jul 2, 2026
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Test: Copilot BYOK (Direct) Mode

✅ GitHub MCP connectivity
✅ GitHub.com connectivity (HTTP 200)
✅ File I/O works
✅ BYOK inference path (agent → api-proxy → api.githubcopilot.com)

Status: PASS
Running in direct BYOK mode via api-proxy sidecar.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

🔑 BYOK report filed by Smoke Copilot BYOK
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🔬 Smoke Test: Copilot PAT Auth

Test Result
GitHub MCP connectivity ✅ MCP reachable
GitHub.com HTTP ⚠️ template vars unresolved
File write/read ⚠️ template vars unresolved

Overall: FAIL — workflow step outputs (steps.smoke-data.outputs.*) were not substituted before agent invocation.

Auth mode: PAT (COPILOT_GITHUB_TOKEN)
Author: @lpcox

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

🔑 PAT report filed by Smoke Copilot PAT
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author
  • fix: chmod squid logs inside container before compose down
  • fix: propagate config fields to all layers
  • merged PR lookup: ✅
  • GitHub query: ✅
  • Playwright title: ✅
  • file write/read: ✅
  • discussion comment: ✅
  • build: ✅
  • overall: PASS

Warning

Firewall blocked 2 domains

The following domains were blocked by the firewall during workflow execution:

  • awmgmcpg
  • registry.npmjs.org

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"
    - "registry.npmjs.org"

See Network Configuration for more information.

🔮 The oracle has spoken through Smoke Codex
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Smoke Test Results\n- GitHub MCP Testing: ❌\n- GitHub.com Connectivity: ❌\n- File Writing Testing: ✅\n- Bash Tool Testing: ✅\n\nOverall Status: FAIL

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • localhost

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "localhost"

See Network Configuration for more information.

💎 Faceted by Smoke Gemini
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🏗️ Build Test Suite Results

Ecosystem Project Build/Install Tests Status
Bun elysia 1/1 passed ✅ PASS
Bun hono 1/1 passed ✅ PASS
C++ fmt N/A ✅ PASS
C++ json N/A ✅ PASS
Deno oak N/A 1/1 passed ✅ PASS
Deno std N/A 1/1 passed ✅ PASS
.NET hello-world N/A ✅ PASS
.NET json-parse N/A ✅ PASS
Go color 1/1 passed ✅ PASS
Go env 1/1 passed ✅ PASS
Go uuid 1/1 passed ✅ PASS
Java gson 1/1 passed ✅ PASS
Java caffeine 1/1 passed ✅ PASS
Node.js clsx All passed ✅ PASS
Node.js execa All passed ✅ PASS
Node.js p-limit All passed ✅ PASS
Rust fd 1/1 passed ✅ PASS
Rust zoxide 1/1 passed ✅ PASS

Overall: 8/8 ecosystems passed — ✅ PASS

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

Generated by Build Test Suite for #5804 · 38.1 AIC · ⊞ 6.9K ·
Add label ready-for-aw to run again

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

🔍 Smoke Test: API Proxy OpenTelemetry Tracing

Scenario Result Details
1. Module Loading otel.js loads cleanly; exports: startRequestSpan, setTokenAttributes, setBudgetAttributes, endSpan, endSpanError, shutdown, isEnabled + test helpers
2. Test Suite 59 passed, 0 failed across otel.test.js + otel-fanout.test.js
3. Env Var Forwarding api-proxy-env-config.ts forwards GH_AW_OTLP_ENDPOINTS, OTEL_EXPORTER_OTLP_ENDPOINT, OTEL_EXPORTER_OTLP_HEADERS, GITHUB_AW_OTEL_TRACE_ID, GITHUB_AW_OTEL_PARENT_SPAN_ID, OTEL_SERVICE_NAME; 18 forwarding tests pass
4. Token Tracker Integration onUsage callback present in token-tracker-http.js (line 283); invoked at line 324 as OTEL hook point
5. OTEL Diagnostics 1 span exported to /tmp/gh-aw/otel.jsonl (FileSpanExporter fallback); span gh-aw.agent.setup with correct trace/parent IDs and workflow attributes

All scenarios passed. OTEL tracing integration is functioning correctly.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "awmgmcpg"

See Network Configuration for more information.

📡 OTel tracing validated by Smoke OTel Tracing
Add label ready-for-aw to run again

@lpcox lpcox merged commit b5d6d77 into main Jul 2, 2026
86 of 89 checks passed
@lpcox lpcox deleted the chore/update-model-api-mapping-2026-07-02-0b50c284bee968a4 branch July 2, 2026 23:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants