Prevent native tools from falling through to shell - #2050
Conversation
|
PII-free behavioral evidence from fixed synthetic prompts, five fresh sessions per variant:
Direct attachment treatment used exactly one For native recovery, all five treatment runs authored the requested shell mistake, all five were intercepted before process start, all five emitted the typed correction, all five activated the deferred native schema, and all five retried natively. Treatment produced zero shell process starts and zero approval requests. One treatment run called the native tool twice, so the strict exact-sequence score is 4/5 rather than 5/5. Baseline emitted no typed correction and hit the approval gate in all five runs. Only aggregate counts are published here; raw artifacts remain local. |
ebcf96f to
5cee328
Compare
5cee328 to
822c60b
Compare
822c60b to
d399e00
Compare
|
Specification-quality update is now on the PR at What changed:
Validation:
This update is documentation and regression coverage only; it does not change production behavior, so the previously recorded behavioral eval evidence remains the relevant evidence for the implementation. No hosted eval was rerun for this cleanup. |
d399e00 to
fd81c56
Compare
fd81c56 to
a17197c
Compare
a17197c to
2b3e7ea
Compare
|
Specification and verification follow-up is available at Changes:
Validation:
This follow-up changes specifications and regression proof only. It does not change production behavior. The existing PII-free behavioral eval results remain applicable. No raw transcript data appears in this update. |
|
Windows follow-up is fixed at The failing test was introduced by the previous specification-proof commit. It depended on a host-specific PowerShell command and filesystem side effect. Windows took a different authorization path, so the test expected the wrong terminal result. The replacement is deterministic:
Validation:
|
Stacked on #2046.
What changed
attach_filea policy-filtered parent-session Core tool and directs agents to attach the authorized source path without a preparatory copy.attach_fileunavailable to subagents until an internal child-to-parent attachment handoff exists.Verification
This PR does not change public or durable contracts.