Any chance of increasing the context?

#2
by DazzlingXeno - opened

Would be great with 16k context or above.

Hey @dazl1212,
I'm not sure if I can do 16K, but 8K might be possible now (RoPE the rest maybe?) with Fimbulvetr-11B-v2.1. I can whip that up for you with a few GGUFs if you like?
Thanks for trying my model! Have good day! :)

Hi mate, that would be awesome. 8k with Chaifighter-20B-v2 will fit my needs great!

Hey @dazl1212 ,
I'm uploading the tweaked model right now. In the meantime, please let me know if you need anything else. :)
Have a great day!

Brilliant! Thank you!

Sign up or log in to comment