Commit df4d206
authored
[Tracing] Copy
## Background ##
* huggingface/transformers#41683 remove some fx
tracing utilities used by LLM Compressor's sequential pipeline
capabilities
## Purpose ##
* Allow LLM Compressor to support latest transformers
## Changes ##
* Copied `src/transformers/utils/fx.py` (with copyright)
* Use `trust_remote_code` for trace testing (the old deepseek model
definitions are not supported with the latest transformers
## Testing ##
* Used `test_models` to test that all models can still trace with
transformers main
* Quantized llama 8B e2e and confirmed sane outputs with transformers
main
---------
Signed-off-by: Kyle Sayers <[email protected]>HFTracer to support latest transformers (#1989)1 parent e7a28ad commit df4d206
File tree
3 files changed
+1661
-2
lines changed- src/llmcompressor/pipelines/sequential
- tests/llmcompressor/transformers/tracing
3 files changed
+1661
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | | - | |
23 | 22 | | |
24 | 23 | | |
25 | 24 | | |
| 25 | + | |
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
| |||
0 commit comments