Skip to content

[Bug]: installation from git is no longer possible on none x86 architectures #2064

@loqs

Description

@loqs

⚙️ Your current environment

The output of python collect_env.py
### Environment Information ###
Operating System: `Linux-6.14.0-1013-nvidia-aarch64-with-glibc2.39`
Python Version: `3.13.9 (main, Oct 31 2025, 23:01:48) [Clang 21.1.4 ]`
llm-compressor Version: `None`
compressed-tensors Version: `0.12.3a20251114`
transformers Version: `4.57.1`
torch Version: `2.9.1+cu130`
CUDA Devices: `['NVIDIA GB10']`
AMD Devices: `None`

🐛 Describe the bug

63c175b added auto_round to dependencies in setup.py. auto_round depends on tbb which is only available from pypi as built wheels for Windows x86-64 and Linux x86-64 with no source option. This causes building from git to fail on none X86 platforms

🛠️ Steps to reproduce

$ git clone https://github.com/vllm-project/llm-compressor
$ cd llm-compressor/
$ pip install .
Processing /home/loqs/github/llm-compressor
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting loguru>=0.7.2 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached loguru-0.7.3-py3-none-any.whl.metadata (22 kB)
Collecting pyyaml>=6.0.1 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached pyyaml-6.0.3-cp313-cp313-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl.metadata (2.4 kB)
Collecting numpy>=2.0.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached numpy-2.3.5-cp313-cp313-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl.metadata (62 kB)
Collecting requests>=2.32.2 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)
Collecting tqdm>=4.66.3 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting torch>=2.7.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Downloading torch-2.9.1-cp313-cp313-manylinux_2_28_aarch64.whl.metadata (30 kB)
Collecting transformers>=4.54.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached transformers-4.57.1-py3-none-any.whl.metadata (43 kB)
Collecting datasets>=4.0.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached datasets-4.4.1-py3-none-any.whl.metadata (19 kB)
Collecting accelerate>=1.6.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached accelerate-1.12.0-py3-none-any.whl.metadata (19 kB)
Collecting nvidia-ml-py>=12.560.30 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached nvidia_ml_py-13.580.82-py3-none-any.whl.metadata (9.6 kB)
Collecting pillow>=10.4.0 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached pillow-12.0.0-cp313-cp313-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl.metadata (8.8 kB)
Collecting compressed-tensors>=0.12.3a2 (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Using cached compressed_tensors-0.12.3a20251114-py3-none-any.whl.metadata (7.0 kB)
Collecting auto_round@ git+https://github.com/intel/auto-round.git@llmc (from llmcompressor==0.8.2.dev65+gdb0b68d9f)
  Cloning https://github.com/intel/auto-round.git (to revision llmc) to /tmp/pip-install-_w0z5uhp/auto-round_49b3f62efbd4410a9f09d0fae5afc953
  Running command git clone --filter=blob:none --quiet https://github.com/intel/auto-round.git /tmp/pip-install-_w0z5uhp/auto-round_49b3f62efbd4410a9f09d0fae5afc953
  Running command git checkout -b llmc --track origin/llmc
  Switched to a new branch 'llmc'
  branch 'llmc' set up to track 'origin/llmc'.
  Resolved https://github.com/intel/auto-round.git to commit d96d41e742b61bed25a792a1d39ae70e857d47c1
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: py-cpuinfo in /home/loqs/vllm-venv-3.13/lib/python3.13/site-packages (from auto_round@ git+https://github.com/intel/auto-round.git@llmc->llmcompressor==0.8.2.dev65+gdb0b68d9f) (9.0.0)
Requirement already satisfied: sentencepiece in /home/loqs/vllm-venv-3.13/lib/python3.13/site-packages (from auto_round@ git+https://github.com/intel/auto-round.git@llmc->llmcompressor==0.8.2.dev65+gdb0b68d9f) (0.2.1)
Requirement already satisfied: packaging in /home/loqs/vllm-venv-3.13/lib/python3.13/site-packages (from auto_round@ git+https://github.com/intel/auto-round.git@llmc->llmcompressor==0.8.2.dev65+gdb0b68d9f) (25.0)
INFO: pip is looking at multiple versions of auto-round to determine which version is compatible with other requirements. This could take a while.
ERROR: Ignored the following versions that require a different python version: 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11; 1.26.0 Requires-Python >=3.9,<3.13; 1.26.1 Requires-Python >=3.9,<3.13
ERROR: Could not find a version that satisfies the requirement tbb (from auto-round) (from versions: none)
ERROR: No matching distribution found for tbb

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions