sliding_window is null?
#84
by
haili-tian
- opened
Comparing with v0.1, the sliding_window is 4096, while in v0.2/v0.3 it's null. Is it correct?
OK, as in v0.2 https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2, it statements SWA is not used
haili-tian
changed discussion status to
closed