docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

[hiqsociety]

have this error running docker

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

Requirement already satisfied: Jinja2>=3.1.2 in /home/user/.local/lib/python3.10/site-packages (from flask==2.3.2->-r requirements-web.txt (line 1)) (3.1.2)
Collecting itsdangerous>=2.1.2 (from flask==2.3.2->-r requirements-web.txt (line 1))
  Downloading itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Collecting click>=8.1.3 (from flask==2.3.2->-r requirements-web.txt (line 1))
  Obtaining dependency information for click>=8.1.3 from https://files.pythonhosted.org/packages/00/2e/d53fa4befbf2cfa713304affc7ca780ce4fc1fd8710527771b58311a3229/click-8.1.7-py3-none-any.whl.metadata
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from flask==2.3.2->-r requirements-web.txt (line 1))
  Downloading blinker-1.6.2-py3-none-any.whl (13 kB)
Requirement already satisfied: MarkupSafe>=2.0 in /home/user/.local/lib/python3.10/site-packages (from Jinja2>=3.1.2->flask==2.3.2->-r requirements-web.txt (line 1)) (2.1.3)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 10.4 MB/s eta 0:00:00
Downloading werkzeug-2.3.7-py3-none-any.whl (242 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 242.2/242.2 kB 8.5 MB/s eta 0:00:00
Installing collected packages: Werkzeug, waitress, itsdangerous, click, blinker, flask
  WARNING: The script waitress-serve is installed in '/home/user/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script flask is installed in '/home/user/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed Werkzeug-2.3.7 blinker-1.6.2 click-8.1.7 flask-2.3.2 itsdangerous-2.1.2 waitress-2.1.2


Removing intermediate container 5872a256e397
 ---> 284156b3470d
Step 10/12 : USER root
 ---> Running in 7620dbec49e9
Removing intermediate container 7620dbec49e9
 ---> dd4d2049c4d5
Step 11/12 : STOPSIGNAL SIGINT
 ---> Running in 8833f16ac9c4
Removing intermediate container 8833f16ac9c4
 ---> 6ffa6b425bba
Step 12/12 : ENTRYPOINT ["/bin/bash", "-c", "/app/entrypoint.sh $0 $@"]
 ---> Running in 66095fa37634
Removing intermediate container 66095fa37634
 ---> a94e0468cf1d
Successfully built a94e0468cf1d
Successfully tagged exllama-web:latest
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# 
root@ubuntu:/usr/local/src/exllama# docker run --gpus all -p 5000:5000 -v /usr/local/src/exllama/models/llama/:/data/model/ --rm -it exllama-web --host 0.0.0.0:5000
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].
root@ubuntu:/usr/local/src/exllama# docker ps -a
CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
root@ubuntu:/usr/local/src/exllama# docker run --gpus all -p 5000:5000 -v /usr/local/src/exllama/models/llama/:/data/model/ --rm -it exllama-web --host 0.0.0.0:5000
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].
root@ubuntu:/usr/local/src/exllama#