Add Support for Frequency Penalties in On Device Sampling#523

Draft

quic-sanising wants to merge 17 commits intoquic:mainfrom

quic-sanising:freq

Commits on Jun 18, 2025

Add sampler transform test

quic-sanising
authored and
sanising
committed

Commits on Jun 30, 2025

Merge branch 'main' into ods-unit-tests
sanising
committed
Add example script
sanising
committed
Update docs
sanising
committed
Enable On Device Sampling for _continuous_batching_execution()
sanising
committed

Commits on Jul 1, 2025

Disable On Device Sampling for _regular_model_execution()
sanising
committed
Use same sampling parameters for each sequence in a batch
sanising
committed

Commits on Jul 2, 2025

Enable On Device Sampling for _regular_model_execution()
sanising
committed

Commits on Jul 3, 2025

Add test for greedy sampling
sanising
committed
Add test for random sampling
sanising
committed
Remove else block
sanising
committed
Merge branch 'main' into ods-unit-tests
sanising
committed
Reformat code
sanising
committed