Add baremetal deployment support for NVIDIA GPUs and RDMA/RoCE networking#159
Open
bbenshab wants to merge 2 commits into
Open
Add baremetal deployment support for NVIDIA GPUs and RDMA/RoCE networking#159bbenshab wants to merge 2 commits into
bbenshab wants to merge 2 commits into
Conversation
bbenshab
force-pushed
the
feature/add-baremetal-support
branch
7 times, most recently
from
79e6b25 to
1f68b9c
Compare
…king - Baremetal overlays for rhoai-stable-2.25, rhoai-fast, and rhoai-eus-2.16 - SR-IOV Network Operator deployment and configuration - NVIDIA Network Operator with MOFED drivers for RDMA - NVIDIA GPU Operator with RDMA support - Automatic RoCE NIC discovery and SR-IOV policy generation - Node preparation with automatic labeling - GitOps health monitor with auto-cleanup capabilities - SR-IOV webhook readiness checks and retry logic - Deployment documentation
bbenshab
force-pushed
the
feature/add-baremetal-support
branch
from
1f68b9c to
49fb9f4
Compare
NFD (Node Feature Discovery) is required for GPU and network operators to detect hardware features on nodes. Changes: - Add NFD operator and instance baremetal overlays - Add NFD to all baremetal ApplicationSets (eus-2.16, fast, stable-2.25) - Deploy NFD at wave 0-1 (before network and GPU operators) NFD labels nodes with hardware features including: - Mellanox NICs (feature.node.kubernetes.io/pci-15b3.present) - NVIDIA GPUs (feature.node.kubernetes.io/pci-10de.present) Without NFD, NVIDIA Network Operator and GPU Operator cannot detect nodes with compatible hardware.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds baremetal deployment support for Red Hat OpenShift AI with NVIDIA GPUs and RDMA/RoCE networking.
Changes
Testing