chore: bump nixl 0.8.0 #4528
chore: bump nixl 0.8.0 #4528
Conversation
| SGLANG_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base" | ||
| SGLANG_BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04" | ||
|
|
||
| NIXL_REF=0.7.1 |
There was a problem hiding this comment.
If vLLM 0.11.2 docker build shows dependency on nixl>=0.6.0, then wouldn't 0.7.1 work as well?
There was a problem hiding this comment.
Yep, but the latest vLLM docker resolves to the latest NIXL, so depends on whether we want complete parity or to just satisfy the reqs
| # NIXL configuration | ||
| ARG NIXL_UCX_REF=v1.19.0 | ||
| ARG NIXL_REF=0.7.1 | ||
| ARG NIXL_UCX_REF=v1.20.x |
There was a problem hiding this comment.
Do we need to bump ucx as well for the 0.8.0 version? We haven't in the past bumps so just checking to make sure.
There was a problem hiding this comment.
I don't know if we "need" to -- this is my first time doing a Dynamo dependency bump, so @alec-flowers would know better. The 0.8.0 changelog ai-dynamo/nixl@0.7.1...0.8.0 shows a UCX bump. It's not mentioned as a breaking change in the NIXL release notes https://github.com/ai-dynamo/nixl/releases/tag/0.8.0 though.
Overview:
vLLM 0.11.2 docker build shows dependency on
nixl>=0.6.0, which resolves to 0.8.0.This PR updates NIXL to 0.8.0; keeping it separate from the vLLM bump PR (#4476) since this affects the base container used by all frameworks.
Details:
Where should the reviewer start?
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)