Skip to content

draft: add built-in Realtime control preview#1645

Draft
benjaminshafii wants to merge 1 commit intofeat/openwork-ui-control-mcpfrom
feat/openwork-built-in-realtime-control
Draft

draft: add built-in Realtime control preview#1645
benjaminshafii wants to merge 1 commit intofeat/openwork-ui-control-mcpfrom
feat/openwork-built-in-realtime-control

Conversation

@benjaminshafii
Copy link
Copy Markdown
Member

Summary

  • Adds the optional built-in OpenAI Realtime control driver on top of the OpenWork UI control/MCP bridge PR.
  • Adds Feature Preview settings for enabling Realtime control, saving the OpenAI key in the local environment store, choosing/testing a microphone, and showing the transcript/activity panel.
  • Adds Electron/macOS microphone permission handling and entitlements plus the server-side /remote/session endpoint for minting short-lived Realtime client secrets.

Stacking

This PR is intentionally stacked on the non-Realtime control-plane PR:

Why draft

Built-in Realtime is a separate product choice from the durable OpenWork control plane. Keeping it draft lets us review or ship the MCP/control-plane work independently.

Verification

  • pnpm install --lockfile-only
  • pnpm install
  • pnpm --filter @openwork/app typecheck
  • pnpm --filter openwork-server typecheck

Earlier full-branch verification artifacts are retained as screenshots in this PR.

@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented May 4, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
openwork-app Ready Ready Preview, Comment May 4, 2026 7:27pm
openwork-den Ready Ready Preview, Comment May 4, 2026 7:27pm
openwork-den-worker-proxy Ready Ready Preview, Comment May 4, 2026 7:27pm
openwork-landing Ready Ready Preview, Comment, Open in v0 May 4, 2026 7:27pm
openwork-share Ready Ready Preview, Comment May 4, 2026 7:27pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 4, 2026

The following comment was made by an LLM, it may be inaccurate:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant