-
Notifications
You must be signed in to change notification settings - Fork 269
[release_v2190] release notes template #3731
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: release_v2190
Are you sure you want to change the base?
Changes from 6 commits
d8f03d7
0533467
57e9750
0ec4746
9bbb0f3
d79f3d0
44d905b
2118930
7650b3c
bf365b2
34bd550
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,5 +1,65 @@ | ||
| # Release Notes | ||
|
|
||
| ## New in Release 2.19.0 | ||
|
|
||
| Post-training Quantization: | ||
|
|
||
| - Breaking changes: | ||
| - (OpenVINO) `nncf.CompressWeightsMode.E2M1` `mode` option is renamed to `nncf.CompressWeightsMode.MXFP4`. | ||
| - General: | ||
| - ... | ||
| - Features: | ||
| - The histogram aggregator was introduced, improving metrics for a number of classification models with PTQ. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (OpenVINO) Introduced several new compression modes in `nncf.CompressWeightsMode`: `MXFP8`, `FP8`, and `FP4`. These can be used as the `mode` option in `nncf.compress_weights()` to apply the corresponding MXFP8, FP8, or FP4 precisions (experimental). | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - Now weight compression biwidth distribution table also displays group size value for each of the compression data type. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (ONNX) Support for the SmoothQuant algorithm has been added to the ONNX backend for INT8 quantization. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (ONNX) A new transformation has been added to optimize models by folding `QuantizeLinear` nodes with constant inputs into precomputed, quantized initializers. This behavior is controlled by the `COMPRESS_WEIGHTS` backend parameter, which is now enabled (`True`) by default. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (ONNX) Support has been added for applying the Fast Bias/Bias Correction algorithm to `MatMul` + `Add` subgraphs where one of the inputs to the `Add` operation is a constant. Previously, these cases were skipped because the `MatMul` operation was not recognized as having a bias, preventing the algorithm from being applied. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - Fixes: | ||
| - Added an ignored pattern for position embedding layer in Segment Anything model. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (ONNX) Fixed incorrect input handling for the `MatMulNBits` operation that previously caused graph breaks. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (ONNX) Resolved an issue with INT4 weight compression in the `Gemm` operation when `transB=1`. | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - Improvements: | ||
| - Maximum memory consumption during statistic collection has been reduced by releasing model output memory before the next statistic collection inference call. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - Reduced peak memory footprint for Bias Correction algorithm. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - (OpenVINO) Reduced time (by up to 3x) and memory (by up to 1.5x) it takes to compress models to `MXFP4` data type. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
| - Deprecations/Removals: | ||
| - ... | ||
| - Tutorials: | ||
| - [Deployment of a Post-Training Optimized Qwen3 Agent](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/supplementary_materials/notebooks/qwen-3/smolagents/qwen3_agent.ipynb) | ||
| - [Post-Training Optimization of ACE Step Model](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/ace-step-music-generation/ace-step-music-generation.ipynb) | ||
| - Known issues: | ||
| - ... | ||
| - Other: | ||
| - Refined the handling of layers that don't have channel size divisible by group size during weight compression. Now the default behavior in such case is that an error will be raised and in the error message users are suggested to provide a different group size value or use `GroupSizeFallbackMode.ADJUST` to automatically adjust group size for problematic layers. | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
|
|
||
| Compression-aware training: | ||
|
|
||
| - Breaking changes: | ||
| - ... | ||
| - General: | ||
| - ... | ||
| - Features: | ||
| - ... | ||
| - Fixes: | ||
| - ... | ||
| - Improvements: | ||
| - ... | ||
| - Deprecations/Removals: | ||
| - ... | ||
| - Tutorials: | ||
| - ... | ||
| - Known issues: | ||
| - ... | ||
|
|
||
| Deprecations/Removals: | ||
|
|
||
| - (TensorFlow) The TensorFlow backend is now marked as deprecated. | ||
|
|
||
| Requirements: | ||
|
|
||
| - Updated PyTorch (2.9.0) and Torchvision (0.24.0) versions. | ||
|
|
||
| ## New in Release 2.18.0 | ||
|
|
||
| Post-training Quantization: | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
#3664