Kquant03 commited on
Commit
283f01c
·
1 Parent(s): 05102fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -2,7 +2,7 @@
2
  # A vastly improved frankenMoE, Named after Raiden from Metal Gear Rising.
3
  [*I said I wouldn't use my sword for vengeance...but now I'm not so sure...and besides...__this isn't my sword.__*](https://metalgear.fandom.com/wiki/Raiden)
4
 
5
- A frankenMoE of [heegyu/WizardVicuna-Uncensored-3B-0719](https://huggingface.co/heegyu/WizardVicuna-Uncensored-3B-0719) that has been accidentally aligned against evil. I was trying to train the experts to have an evil alignment and instead only exponentially increased its alignment towards good, so I named it after the hero of one of my favorite games. [The yml I wrote that caused this alignment is here.](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T)
6
 
7
  ### [My last model ](https://huggingface.co/Kquant03/PsychoOrca_32x1.1B_MoE_fp16)was an attempt to improve the overall coherence of TinyLlama models. It failed spectacularly. However, I was amused enough by the results to try frankenMoE with a better model. Although it didn't achieve the level of unbridled evil I was hoping for...The results of this were good enough to post, in my opinion.
8
 
 
2
  # A vastly improved frankenMoE, Named after Raiden from Metal Gear Rising.
3
  [*I said I wouldn't use my sword for vengeance...but now I'm not so sure...and besides...__this isn't my sword.__*](https://metalgear.fandom.com/wiki/Raiden)
4
 
5
+ A frankenMoE of [heegyu/WizardVicuna-Uncensored-3B-0719](https://huggingface.co/heegyu/WizardVicuna-Uncensored-3B-0719) that has been accidentally aligned against evil. I was trying to train the experts to have an evil alignment and instead only exponentially increased its alignment towards good, so I named it after the hero of one of my favorite games. [The yml I wrote that caused this alignment is here.](https://huggingface.co/Kquant03/Raiden-16x3.43B/blob/main/Dark.yml)
6
 
7
  ### [My last model ](https://huggingface.co/Kquant03/PsychoOrca_32x1.1B_MoE_fp16)was an attempt to improve the overall coherence of TinyLlama models. It failed spectacularly. However, I was amused enough by the results to try frankenMoE with a better model. Although it didn't achieve the level of unbridled evil I was hoping for...The results of this were good enough to post, in my opinion.
8