Skip to content

BPE tokenizer in pure Zig, with a Python API.

Latest

Choose a tag to compare

@jaco-bro jaco-bro released this 09 May 21:29
· 2 commits to main since this release
e37bcf1

See it in action at nnx-lm!