Is there any way to run on a 40G GPU?

[supersyz]

Hi, really appreciate for your great job!
Is there any way to run on a 40G GPU?

[haoyi-duan]

Hi, thank you for the kind words! We tested it on a 48G L40S GPU. However, we're not entirely sure if the memory overhead precisely requires 48G — it might be slightly less. I am sure it cannot run on a 24G GPU, but you’re welcome to give it a try on a 40G GPU!

[supersyz]

Thanks a lot！