Skip to content

Bump ROCm versions, re-enable in GHA #14098

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

gremlinofthemysticarts
Copy link

It seems to issue with compilation has been resolved, as I can build locally. However, ROCm memory detection seems to be broken, with models only being able to use ~600MiB of video memory.

@github-actions github-actions bot added the devops improvements to build systems and github actions label Jun 10, 2025
@ggerganov
Copy link
Member

However, ROCm memory detection seems to be broken, with models only being able to use ~600MiB of video memory.

Is this a problem on our end or?

@ggerganov ggerganov requested a review from IMbackK June 10, 2025 14:41
@gremlinofthemysticarts
Copy link
Author

Is this a problem on our end or?

Unfortunately I don't know. My skills in c++ and this sort of programming (GPU) are fairly low - I know there have been some issues with memory allocation with HIP/ROCm in the past (e.g #13698) but I don't really know where to start.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops improvements to build systems and github actions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants