Skip to content

feat(kv-offload): import the server-allocated KV arena over CUDA IPC - #764

Open
xiaguan wants to merge 3 commits into
mainfrom
feat/pegaflow-arena-import
Open

feat(kv-offload): import the server-allocated KV arena over CUDA IPC#764
xiaguan wants to merge 3 commits into
mainfrom
feat/pegaflow-arena-import

fix(glm52): refuse KV offload before the multi-GPU weight load

9788b56
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar