GPU issues #9
Description
Hello,
Your project is truly outstanding and fascinating. However, I have a few questions regarding the GPU, so I am leaving this message.
As the authors mentioned, The VRAM requirements for pds and pds_splat are around 40GB and 2GB -> I attempted training with two or three 24GB GPUs. However, the --pipeline.pds_device "cuda:1" option does not seem to function properly. Most of the memory is being allocated to a single GPU, causing an OOM (Out of Memory) issue.
Additionally, I also attempted training with pds_splat, but contrary to the authors' statement that it requires 2GB, I found that it actually requires up to a maximum of 15GB.
Could you please share any solutions for utilizing multiple GPUs or any other settings you used during training? I would greatly appreciate your help.
Thank you.