Failed to build installable wheels #1887
Description
Output
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml): started
Building wheel for tokenizers (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [561 lines of output]
...
error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
--> tokenizers-lib/src/models/bpe/trainer.rs:517:47
|
513 | let w = &words[*i] as *const _ as *mut _;
| -------------------------------- casting happened here
...
517 | let word: &mut Word = &mut (*w);
| ^^^^^^^^^
|
= note: for more information, visit <https://doc.rust-lang.org/book/ch15-05-interior-mutability.html>
= note: `#[deny(invalid_reference_casting)]` on by default
...
warning: `tokenizers` (lib) generated 8 warnings
error: could not compile `tokenizers` (lib) due to 1 previous error; 8 warnings emitted
Caused by:
process didn't exit successfully: `/home/runner/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/bin/rustc --crate-name tokenizers --edition=2018 tokenizers-lib/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="indicatif"' --cfg 'feature="progressbar"' --check-cfg 'cfg(docsrs,test)' --check-cfg 'cfg(feature, values("default", "indicatif", "progressbar"))' -C metadata=51d9c7d9db92ae43 -C extra-filename=-bb93a95a888a37c5 --out-dir /tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps -C strip=debuginfo -L dependency=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps --extern clap=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps/libclap-9e49d0a21e9c384a.rmeta --extern derive_builder=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee08
warning: build failed, waiting for other jobs to finish...
error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --` failed with code 101
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
error: failed-wheel-build-for-install
× Failed to build installable wheels for some pyproject.toml based projects
╰─> tokenizers
First identified at Nov 2, 9:38 AM GMT+8
Last operational time: Oct 26, 9:36 AM GMT+8
System: Ubuntu (GitHub Actions)
Command: python -m pip install huggingface_hub[cli] transformers
Python version: 3.12