Skip to content

Conversation

@ZX-ModelCloud
Copy link
Contributor

Remove autogptq clutter and autogptq related configs that are not worth adding backward compat.
See
huggingface/transformers#41567
huggingface/optimum#2385

Signed-off-by: ZX-ModelCloud <[email protected]>
Signed-off-by: ZX-ModelCloud <[email protected]>
@ZX-ModelCloud ZX-ModelCloud changed the title [WIP] Fully deprecate AutoGPTQ for GPT-QModel [WIP] Fully deprecate AutoGPTQ and AutoAWQ for GPT-QModel Dec 1, 2025
Signed-off-by: ZX-ModelCloud <[email protected]>
Signed-off-by: ZX-ModelCloud <[email protected]>
@ZX-ModelCloud ZX-ModelCloud marked this pull request as ready for review December 2, 2025 09:07
@ZX-ModelCloud ZX-ModelCloud changed the title [WIP] Fully deprecate AutoGPTQ and AutoAWQ for GPT-QModel Fully deprecate AutoGPTQ and AutoAWQ for GPT-QModel Dec 2, 2025
@Qubitium
Copy link
Contributor

Qubitium commented Dec 2, 2025

@BenjaminBossan PR is now synced to Optimum/Transformer pending Prs. Ready for final review for this portion. All relevant tests passing paired with the tranformer companion pr with pending gpt-qmodel 5.4.4 release (later today).

Signed-off-by: ZX-ModelCloud <[email protected]>
Signed-off-by: ZX-ModelCloud <[email protected]>
@BenjaminBossan
Copy link
Member

Thanks for all the work @ZX-ModelCloud and @Qubitium. Let's wait for the transformers PR to be merged and then do the final testing on PEFT.

There is a small merge conflict now in the Dockerfile. It's just because we use conda run now, it should be easy to fix. Could you please take care?

@ZX-ModelCloud
Copy link
Contributor Author

Thanks for all the work @ZX-ModelCloud and @Qubitium. Let's wait for the transformers PR to be merged and then do the final testing on PEFT.

There is a small merge conflict now in the Dockerfile. It's just because we use conda run now, it should be easy to fix. Could you please take care?

Thank you for your reply. The Dockerfile conflict has been resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants