feat(ENG-EXPERT-STREAM-DEVICE): W0f — the dense weights were resident twice; --device cuda now decodes, and the token gate fails on a near-tie the alias is measured not to cause (#1299) #1015
localai-botAnnotations
2 errors
|
plan
Canceling since a higher priority waiting request for containers-pull_request-1326-mudler/vllm.cpp exists
|
|
containers
Canceling since a higher priority waiting request for containers-pull_request-1326-mudler/vllm.cpp exists
|