Skip to content

bug: CUDA build workflow not installing correct CUDA version #2089

@chamalgomes

Description

@chamalgomes

Prerequisites

Please answer the following questions for yourself before submitting an issue.

  • I am running the latest code. Development is very rapid so there are no tagged versions as of now.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new bug or useful enhancement to share.

Expected Behavior

CUDA build workflow (build-wheels-cuda.yaml ) should install the requested version of CUDA toolkit required for the CUDA build process.

Current Behaviour

Right now CUDA build workflow does not install the requested cuda-toolkit version during CUDA build process.

See below where I replicated the issue,

https://github.com/ChamalGomesHSO/llama-cpp-python/actions/runs/19285030787/job/55143931103

In short I requested 12.4.1 but Mamba installed cuda-toolkit 13.0.1 instead:

Image

Environment and Context

GitHub workflow (CUDA build):

To reproduce the error as shown above I restricted the build scope of the CUDA build workflow to the following (but it applied to all combinations in the matrix)

Python version 3.13
OS: Ubuntu 22.04
CUDA: 12.4.1

Steps to Reproduce

Please provide detailed steps for reproducing the issue. We are not sitting in front of your screen, so the more detail the better.

  1. Run the existing build CUDA workflow (build-wheels-cuda.yaml )
  2. Check Mamba installation step logs
  3. You will notice requested CUDA does not match with mamba installation

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions