acrastt

/

Marx-3B

like 13

Generated with:

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("acrastt/Marx-3B")
assert tokenizer.is_fast
tokenizer.save_pretrained("...")

Thanks! For some reason the original tokenizer didn't get copied from the base model.