Skip to content

Remove the +8192 rounding-bias offset from kLinearToGammaTab - #182

Merged
skal65535 merged 1 commit into
mainfrom
skal/gamma-table-rounding
Sep 1, 2026
Merged

Remove the +8192 rounding-bias offset from kLinearToGammaTab#182
skal65535 merged 1 commit into
mainfrom
skal/gamma-table-rounding

Conversation

@skal65535

Copy link
Copy Markdown
Collaborator
  • LinearToGamma() now returns [0, MAX_Y_T] as documented, not [8192, 9215]
  • entries were used a differences (e.g. 'r - W'), so offset was cancelling
  • verified bit-exact change

@skal65535 skal65535 self-assigned this Aug 31, 2026
@skal65535
skal65535 requested a review from jzern August 31, 2026 09:59
@skal65535
skal65535 force-pushed the skal/gamma-table-rounding branch from 00dc983 to cd7249b Compare August 31, 2026 21:33
Base automatically changed from skal/sharp-yuv-avx2 to main September 1, 2026 05:09
* LinearToGamma() now returns [0, MAX_Y_T] as documented, not [8192, 9215]
* entries were used a *differences* (e.g. 'r - W'), so offset was cancelling
* verified bit-exact change
@skal65535
skal65535 force-pushed the skal/gamma-table-rounding branch from cd7249b to 8ec4871 Compare September 1, 2026 05:09
@skal65535
skal65535 merged commit 8d73443 into main Sep 1, 2026
13 checks passed
@skal65535
skal65535 deleted the skal/gamma-table-rounding branch September 1, 2026 05:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants