Skip to content

Commit ccf3fc9

Browse files
committed
replaced untokenize to detokenize
1 parent e145c4b commit ccf3fc9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pyllamacpp/model.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ def tokenize(self, text:str):
119119
"""
120120
return pp.llama_tokenize(self._ctx, text, True)
121121

122-
def untokenize(self, tokens:list):
122+
def detokenize(self, tokens:list):
123123
"""
124124
Returns a list of tokens for the text
125125
:param text: text to be tokenized

0 commit comments

Comments
 (0)