Skip to content

Examples.torch.quantize ERROR #4095

Description

@bqFirst

Issue Description:

When I run python -m Examples.torch.quantize, I get the following error:

RuntimeError: Failed to run QuantizeDequantize since quantization parameters are not initialized. Please initialize the quantization parameters using compute_encodings().

After I call compute_encodings() before _prefill_inputs, the problem disappears.

Is this a bug?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

aimet-torchNew feature or bug fix for AIMET PyTorchllm

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions