Update tokenizer_config.json
#2
by
saattrupdan
- opened
The NeuralBeagle model recently updated its tokenization config to fix the bugs with it, and this simply copy-pastes this in here.
The NeuralBeagle model recently updated its tokenization config to fix the bugs with it, and this simply copy-pastes this in here.