Skip to content

feat(thicktoken): replace tiktoken with in-repo Rust→WASM tokenizer engine#691

Merged
slvnperron merged 6 commits into
masterfrom
chore/thicktoken-dep-updates
Jul 2, 2026
Merged

feat(thicktoken): replace tiktoken with in-repo Rust→WASM tokenizer engine#691
slvnperron merged 6 commits into
masterfrom
chore/thicktoken-dep-updates

fix(thicktoken): address review — single-pass slice, dedupe CountOptions

e852290
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar