Description
My graphic card for vllm is old, so things like Hands take time. I would like to be able to set timeout manually to “0”, so my old graphic card has time to whatever it needs to do.
Alternatives Considered
No response
Additional Context
No response
Description
My graphic card for vllm is old, so things like Hands take time. I would like to be able to set timeout manually to “0”, so my old graphic card has time to whatever it needs to do.
Alternatives Considered
No response
Additional Context
No response