We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently we use llama.cpp Vulkan build for AMD GPUs. HIP build should have better perf. (we should have benchmark test for that too)
Once #2128 lands, we should be able to use upstream HIP builds for Windows
There is no upstream HIP builds for Linux. We might need to build it ourselves, though I think we need AMD GPUs for that.
cc: @david-menloai @sangjanai @qnixsynapse
See above
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Problem Statement
Currently we use llama.cpp Vulkan build for AMD GPUs. HIP build should have better perf. (we should have benchmark test for that too)
Once #2128 lands, we should be able to use upstream HIP builds for Windows
There is no upstream HIP builds for Linux. We might need to build it ourselves, though I think we need AMD GPUs for that.
cc: @david-menloai @sangjanai @qnixsynapse
Feature Idea
See above
The text was updated successfully, but these errors were encountered: