emozilla

/

open_llama_7b-scaled

like 10

When I change the context window to something like 4096, I get poor results(repeating tokens), even well before the original 2048 limit. When I leave it at the default, this behavior is not seen.

I am using the model as is. Do I need to finetune to achieve good results?