You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
openvino integration would be nice to have,
but since i saw at the bottom of the page - optimum, this is also a question.
Does it maybe already have some kind of support for it(eg gpu/igpu via openvino) or openvino alone(sibling with cuda/rocm/cpu)?
O.v. has it's own ir format of files via conversion(tools for it are there - py code,cli-tools), so i don't know if this would be straightforward to integrate.
There is also sycl thing, which for example llama.cpp use(mostly for intelgpus) and it works ok.
By the way, can be multiple title types added for new 'issue', eg [FEATURE][QUESTION] - would it work?
Similar Features or References
No response
The text was updated successfully, but these errors were encountered:
Feature Description
openvino integration would be nice to have,
but since i saw at the bottom of the page - optimum, this is also a question.
Does it maybe already have some kind of support for it(eg gpu/igpu via openvino) or openvino alone(sibling with cuda/rocm/cpu)?
O.v. has it's own ir format of files via conversion(tools for it are there - py code,cli-tools), so i don't know if this would be straightforward to integrate.
There is also sycl thing, which for example llama.cpp use(mostly for intelgpus) and it works ok.
By the way, can be multiple title types added for new 'issue', eg [FEATURE][QUESTION] - would it work?
Similar Features or References
No response
The text was updated successfully, but these errors were encountered: