Skip to content

Bump ROCm versions, re-enable in GHA #14098

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

gremlinofthemysticarts
Copy link

It seems to issue with compilation has been resolved, as I can build locally. However, ROCm memory detection seems to be broken, with models only being able to use ~600MiB of video memory.

@github-actions github-actions bot added the devops improvements to build systems and github actions label Jun 10, 2025
@ggerganov
Copy link
Member

However, ROCm memory detection seems to be broken, with models only being able to use ~600MiB of video memory.

Is this a problem on our end or?

@ggerganov ggerganov requested a review from IMbackK June 10, 2025 14:41
@gremlinofthemysticarts
Copy link
Author

Is this a problem on our end or?

Unfortunately I don't know. My skills in c++ and this sort of programming (GPU) are fairly low - I know there have been some issues with memory allocation with HIP/ROCm in the past (e.g #13698) but I don't really know where to start.

@IMbackK
Copy link
Collaborator

IMbackK commented Jun 13, 2025

This pr is generally fine, but lets investigate @gremlinofthemysticarts problem first.

I cant reproduce this on my machine atm. @gremlinofthemysticarts could you file an issue with more information on your setup and what your are trying to do to aid in repoduction?

@gremlinofthemysticarts
Copy link
Author

Will do!

@gremlinofthemysticarts
Copy link
Author

Created issue as #14178

@IMbackK
Copy link
Collaborator

IMbackK commented Jun 14, 2025

Superseded by #14184

@IMbackK IMbackK closed this Jun 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops improvements to build systems and github actions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants