Skip to content

Commit 84c2f40

Browse files
add cpu device support for nixl
1 parent 66a168a commit 84c2f40

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/distributed/kv_transfer/kv_connector/v1/nixl_connector.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -83,6 +83,7 @@
8383
),
8484
"tpu": ("cpu",),
8585
"xpu": ("cpu",),
86+
"cpu": ("cpu",),
8687
}
8788
# support for oot platform by providing mapping in current_platform
8889
_NIXL_SUPPORTED_DEVICE.update(current_platform.get_nixl_supported_devices())

0 commit comments

Comments
 (0)