Really good model
#3
by
CamiloMM
- opened
Running JayhC_ChaoticSoliloquy-4x8B-6bpw-h6-exl2. ChatML, and settings meant for a totally unrelated model, RPStew.
I didn't even try to set it up or learn its quirks, it just worked well on the first try. I would expect that of a much larger model. If I'm not mistaken this frankenmerge shouldn't be as good as a proper 8x7b, but it is.
The model is theoretically good, but... if I ask to write a long and detailed story on a certain topic, the model rewrites the topic I described in other words, without writing any “long and detailed” story. By the way, this is the only model that behaves like this.