slow inference RTX 2 even with A100 GPU #3
Description
Despite small model size, the inference is slow. I am getting RTX 2 even with A100 GPU. Is something wrong with my setup?
{{ message }}
Despite small model size, the inference is slow. I am getting RTX 2 even with A100 GPU. Is something wrong with my setup?