romansetu-cpt-roman-100m / added_tokens.json
Thanmay's picture
Upload tokenizer
bea32f1 verified
raw
history blame contribute delete
21 Bytes
{
"<pad>": 32000
}