Disable bos token

#1
by quantflex - opened

Hello ๐Ÿ™‚,

Lets disable bos as according to line 8 in config.json:

https://huggingface.co./Infinigence/Megrez-3B-Instruct/blob/main/config.json#L8

Thank you

Is this repo active? The bos needs to be disabled to create proper quants (gguf).

Infinigence org

Thanks for reporting this!

ZheeRIKO changed pull request status to merged

Sign up or log in to comment