Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

[dportabella]

$ docker build -t localgpt .
  1.460 ModuleNotFoundError: No module named 'utils'
fix: https://github.com/PromtEngineer/localGPT/issues/763

$ docker run -it --mount src="$HOME/.cache",target=/root/.cache,type=bind --gpus=all localgpt
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

[dportabella]

My NVIDA container toolkit and CUDA drivers were not installed correctly. Here's a how-to for ubuntu 24.04:
https://dev.to/mahmoudrasmyfathy1/deploy-mistral-llm-on-google-compute-engine-with-docker-gpu-support-and-hugging-face-inference-server-dbb
https://linuxconfig.org/how-to-install-nvidia-drivers-on-ubuntu-24-04

# install docker
sudo apt-get update
sudo apt-get install ca-certificates curl gnupg
sudo install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
sudo chmod a+r /etc/apt/keyrings/docker.gpg
echo \
  "deb [arch="$(dpkg --print-architecture)" signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
  "$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \
  sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update
sudo apt-get --reinstall install docker-ce
sudo groupadd docker
sudo usermod -aG docker $USER
systemctl status docker

# Install NVIDIA Container Toolkit
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo sed -i -e '/experimental/ s/^#//g' /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker

# Installing CUDA Drivers  https://linuxconfig.org/how-to-install-nvidia-drivers-on-ubuntu-24-04
ubuntu-drivers devices
sudo ubuntu-drivers autoinstall
sudo reboot
systemctl status nvidia-persistenced
nvidia-smi