[ROCm] Building from source for ROCm results in fbgemm_gpu_config.so: cannot open shared object file: No such file or directory

[nikhil-tensorwave]

We are building fbgemm_gpu from source for ROCm but when we run an actual inference request, we get the error:

fbgemm_gpu_config.so: cannot open shared object file: No such file or directory

We followed the build instructions from the documentation, specifically "Preparing the Build", "The Build Process", "Set Wheel Build Variables", and then "ROCm Build." The build itself completes without errors.

We also noticed that the docs say to use the v1.2.0 branch but that branch does not exist on the public repo. Appreciate any guidance on this issue

[q10]

Hi @nikhil-tensorwave Starting from 1.2.0, FBGEMM_GPU ROCm is now properly distributed as a variant on download.pytorch.org:

pip install torch --index-url https://download.pytorch.org/whl/rocm6.3/
pip install fbgemm-gpu --index-url https://download.pytorch.org/whl/rocm6.3/