-
Notifications
You must be signed in to change notification settings - Fork 0
Document the Windows Connector public test track #59
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,96 @@ | ||
| # DevinX Connector for Windows — physical test checklist | ||
|
|
||
| Status: required acceptance evidence for the Windows 11 x64 public test track. | ||
|
|
||
| ## Use only the verified Store package | ||
|
|
||
| Install [DevinX Connector from Microsoft Store](https://apps.microsoft.com/detail/9N52Z3FVMFH8). | ||
| Confirm all of the following before pairing: | ||
|
|
||
| - product name: **DevinX Connector** | ||
| - publisher: **DevinX Tools** | ||
| - Store ID: `9N52Z3FVMFH8` | ||
| - version: `0.1.1.0` or newer | ||
| - device: Windows 11 x64, build `10.0.22000` or newer | ||
|
|
||
| Do not download, sideload, or run an unsigned MSIX, EXE, or ZIP from GitHub Actions. Never share a | ||
| pairing QR, device credential, Devin credential, Tailscale key, or unredacted diagnostic bundle. | ||
|
|
||
| ## Prerequisites | ||
|
|
||
| - Install and authenticate the official **Devin for Terminal** CLI. | ||
| - Confirm `devin --version` works in a normal, non-administrator terminal for the signed-in user. | ||
| - Install Tailscale on the Windows PC and iPhone, sign both into the same tailnet, and leave | ||
| Tailscale connected. | ||
| - Install the current DevinX TestFlight build on the iPhone. | ||
|
|
||
| Record the Windows build, Connector version, Devin CLI version, and iPhone build before testing. | ||
|
|
||
| ## Required acceptance matrix | ||
|
|
||
| ### 1. Install and first launch | ||
|
|
||
| - Install from Microsoft Store as a standard user without running as Administrator. | ||
| - Open Connector and confirm it detects both Tailscale and Devin for Terminal. | ||
| - Confirm the window shows a short-lived pairing code without exposing credentials. | ||
| - Close the window and confirm Connector remains available from the notification-area icon. | ||
| - Choose **Quit DevinX Connector** and confirm the listener stops. | ||
|
|
||
| ### 2. Pairing and permission separation | ||
|
|
||
| - Reopen Connector and generate a fresh code. | ||
| - In DevinX, open **Settings → Local devices → Add local device** and scan the code. | ||
| - Deny one pairing request and confirm the phone receives a recoverable failure. | ||
| - Generate a new code, approve the named iPhone, and grant read access only. | ||
| - Confirm session titles/history load but sending and creating remain unavailable. | ||
| - Add steering and session-creation grants separately; confirm each capability appears only after | ||
| its grant is approved. | ||
| - Let one unused code expire and confirm it cannot be replayed. | ||
|
|
||
| ### 3. Sessions and interactive work | ||
|
|
||
| - Load the local session list and open an existing session with history. | ||
| - Create a new local session in an approved workspace. | ||
| - Send a steering message and confirm exactly one response appears. | ||
| - Trigger an `AskUserQuestion` request, answer it on the iPhone, and confirm the local session | ||
| continues. | ||
| - Change or refresh the model catalog and confirm a failed refresh preserves the prior valid list. | ||
| - Lock a session from another client and confirm DevinX reports a recoverable in-use state rather | ||
| than duplicating work. | ||
|
|
||
| ### 4. Connectivity and recovery | ||
|
|
||
| - Put the PC to sleep, wake it, and confirm the same paired iPhone reconnects. | ||
| - Disconnect and reconnect Tailscale; confirm Connector never falls back to Wi-Fi, LAN, a wildcard | ||
| interface, or a public listener. | ||
| - Change the PC's Tailscale address if practical, rescan a fresh code, and confirm the existing | ||
| device record refreshes instead of duplicating. | ||
| - Disconnect from the iPhone while Connector is running, then pair again. | ||
| - Revoke the iPhone from Connector and confirm further protected requests return a generic failure | ||
| without revealing session existence. | ||
| - Confirm the most recently paired device appears first. | ||
|
|
||
| ### 5. Startup, update, and removal | ||
|
|
||
| - Enable **Launch at sign-in**, sign out or reboot, and confirm Connector starts for that user. | ||
| - Disable launch at sign-in in Connector and confirm the setting remains off after reboot. | ||
| - If Microsoft Store offers an update, install it and confirm pairing and grants remain intact. | ||
| - Test **Repair** from Windows settings if available. | ||
| - Uninstall Connector and confirm only Connector files/state are removed; Devin CLI and Tailscale | ||
| remain installed. | ||
| - Reinstall from Microsoft Store and confirm a fresh QR pairing is required after a full reset. | ||
| - Sign into a second Windows user and confirm the first user's Connector identity and grants are | ||
| unavailable. | ||
|
|
||
| ## Report | ||
|
|
||
| Report pass/fail for each numbered section. For any failure, include: | ||
|
|
||
| - the numbered step | ||
| - Windows build, Connector version, Devin CLI version, and iPhone build | ||
| - the exact visible error text | ||
| - a screenshot with QR codes, credentials, account identifiers, repository names, and private | ||
| session content redacted | ||
| - whether retrying, reopening Connector, or reconnecting Tailscale changed the result | ||
|
|
||
| Passing automated CI and Microsoft Store certification does not replace this physical matrix. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🔍 Unchanged capability-boundaries text may now contradict the new public-test-track messaging
This PR reframes the Windows Connector as a Store-signed package that is now publicly installable for controlled testing (
README.md:152-153). However, the "Honest capability boundaries" section atREADME.md:229-232(outside the diff) still states "Windows 11 x64 is an active release implementation whose public download activates only after its signature and physical compatibility gates pass." Now that the Store package is described as publicly installable, this older wording reads as contradictory. Consider updating it to distinguish the public test track from a fully supported download for consistency with the rest of the PR.Was this helpful? React with 👍 or 👎 to provide feedback.