feat(kv-offload): export KV via VMM dma-buf fd instead of CUDA IPC - #740
Closed
xiaguan wants to merge 6 commits into
Closed
feat(kv-offload): export KV via VMM dma-buf fd instead of CUDA IPC#740xiaguan wants to merge 6 commits into
xiaguan wants to merge 6 commits into