Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Optional rocSOLVER at run time #896

Open
cgmb opened this issue Jul 31, 2024 · 0 comments
Open

[Feature]: Optional rocSOLVER at run time #896

cgmb opened this issue Jul 31, 2024 · 0 comments
Assignees

Comments

@cgmb
Copy link
Contributor

cgmb commented Jul 31, 2024

Suggestion Description

There is a BUILD_WITH_SOLVER CMake option, but it would be nice if the rocsolver library could be loaded at run-time with dlopen when BUILD_WITH_SOLVER is OFF. This would allow Debian and Ubuntu systems packages to build with -DBUILD_WITH_SOLVER=OFF and mark rocsolver as a recommended package, rather than a required dependency. The behaviour for BUILD_WITH_SOLVER=ON would be unchanged (and would be needed for static hipBLAS builds).

Users that wish to use hipBLAS for applications such as llama-cpp currently must install hipBLAS, which depends on rocSOLVER, which depends on rocSPARSE. Despite only wanting to run a few GEMMS, they end up installing several gigabytes of other libraries that provide functionality that they do not need for their particular application. The rocSOLVER library has made rocSPARSE an optional dependency for this reason, and I think it would be a good idea for hipBLAS to do the same.

The rocSOLVER library would still be installed with hipblas by default, but users could specifically request --no-install-recommends to avoid it (or could explicitly uninstall rocsolver).

Operating System

Ubuntu

GPU

No response

ROCm Component

hipBLAS

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants