Update tokenizer_config.json

#8
by quaeast - opened

Add model_max_length param to tokenizer_config

Cannot merge
This branch has merge conflicts in the following files:
  • tokenizer_config.json

Sign up or log in to comment