this model have their original restriction staying on their weight
looks like this merger capture the weight for the restriction more, another merger with model that have negative attitude or even albitred will help this model by a lot
Yeah, it's way more restricted. I wanted to focus on getting chain of thought solid before I run an abliteration pass.
Fun fact: If you don't want it to be restricted... Change the one word that you want it to accept to Chinese. I've gotten it to accept some very crazy requests that way.
Kobold has a cute but remarkably effective jailbreak. It precedes each reply by the model with: "Sure I can help with that:" and the model then continues this reply assuming, I guess, that it had already accepted to do this.
😍 That's pretty cool! That's something you can't get from a chat completion API. Once you inject guidance in to most models it will overwhelm the alignment. Most restrictive alignment is very shallow - which is why the original 'abliteration is one direction' works so well.