feat(kv-offload): use external PegaFlow server#729
Conversation
4d4f98b to
5a2c6ba
Compare
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 4d4f98b04e
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| .release(deadline_request(ReleaseRequest { lease })) | ||
| .await | ||
| .map_err(|err| rpc_error("release", err))?; |
There was a problem hiding this comment.
Check release RPC status before dropping leases
When a lease release reaches the server but is rejected at the application layer, this call currently drops the RPC response and returns Ok(()); unlike health/save/load/flush, it never validates the returned status. In the reservation-pressure and abandoned-prefetch paths this makes failed releases look successful, so host blocks can remain pinned until the server TTL instead of being surfaced as a release failure.
Useful? React with 👍 / 👎.
Signed-off-by: xiaguan <751080330@qq.com>
5a2c6ba to
38a6201
Compare
Signed-off-by: xiaguan <751080330@qq.com>
Signed-off-by: xiaguan <751080330@qq.com>
Signed-off-by: xiaguan <751080330@qq.com>
Signed-off-by: xiaguan <751080330@qq.com>
Closes #724
Depends on novitalabs/pegaflow#407.
Summary
Validation on final PR heads
prek runcargo test --release -p openinfer-kv-offload --lib(9 passed)Cross-process gate status
The Qwen3 byte-exact restore and GLM5.2 EP8 host-restore gates passed before the PegaFlow PR reached its final scope. Those results remain design evidence, but the gates must be replayed on the final heads before deployment.