Sync with official tokenizer_config.json
#3
by
so-anyway
- opened
Hi,
The official tokenizer_config.json got updated and I was wondering if you could update it here too?
It has some fixes in it. Thank you.
Wow, thank you for your support!
Orion-zhen
changed pull request status to
merged