Skip to content

Commit 5f851fe

Browse files
committed
nit
1 parent 55c1652 commit 5f851fe

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/convert_slow_tokenizer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1849,7 +1849,7 @@ def convert_slow_tokenizer(transformer_tokenizer, from_tiktoken=False) -> Tokeni
18491849
return converter_class(transformer_tokenizer).converted()
18501850
elif transformer_tokenizer.vocab_file.endswith("tekken.json"):
18511851
transformer_tokenizer.original_tokenizer = transformer_tokenizer
1852-
logger.info("Converting from Mistral tekken.json (spm-based)")
1852+
logger.info("Converting from Mistral tekken.json")
18531853
return MistralConverter(transformer_tokenizer.vocab_file).converted()
18541854
else:
18551855
try:

0 commit comments

Comments
 (0)