How to convert tokenizer in .model format
#4
by
arpit2601
- opened
Hi
@loubnabnl
,
I am trying to run this model in executorch which accepts the tokenizer in .model format but in Files only tokenizer.json is provided. How would I go about converting the tokenizer from .json format into .model format.