This repository was archived by the owner on Apr 23, 2024. It is now read-only.

This repository was archived by the owner on Apr 23, 2024. It is now read-only.

Special tokens accessibility #111

Open

opened

on Sep 11, 2023

is there a way to access the special tokens via the object of youtokenme.BPE(), it's in yytm.pyx file and it's object is created inside the train method of the same file. can someone help me?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests