TomGrc

/

FusionNet_7Bx2_MoE_14B

like 36

@TheBloke this would be great!

yeah waiting

Leaderboard shows some impressive results...

@TheBloke would really appreciate a GGUF version for this model, thank you!

@TheBloke please consider making a GGUF version of this. Just look at its scores

Strange @TheBloke is not doing gguf for this model.
EDIT: i meant it doesnt seem so as its 16th and he must have received the notifications regarding this post.

Strange @TheBloke is not doing gguf for this model.

did you ask him?

TheBloke is not your slave. Is it too hard to call a Python script to do it yourself ?

TheBloke is not your slave. Is it too hard to call a Python script to do it yourself ?

I said "please consider". Maybe you need to learn to read better

TheBloke is not your slave. Is it too hard to call a Python script to do it yourself ?

among the tons of models he compiles , what's wrong with doing one on the leaderboard.
Also isn't that the reason people know him?

I have generated the gguf quantized version of the model.
The files can be found at https://huggingface.co./Nan-Do/FusionNet_7Bx2_MoE_14B-GGUF

I have generated the gguf quantized version of the model.
The files can be found at https://huggingface.co./Nan-Do/FusionNet_7Bx2_MoE_14B-GGUF

Thx @Nan-Do , I will try it asap

@johnnnna pls do give feeback , wonder if its actually good or hoax.

@Nan-Do 's quants does not work for me (it generates random tokens) so I made my own basic quants of this model.

https://huggingface.co./Rybens/FusionNet_7Bx2_MoE_14B_gguf

@Rybens there was indeed a problem with the uploaded files, thanks for letting me know. I should have checked the uploaded files.

I have redone the repository (and re-checked the files) and it should be fine now, also I have added a model's card.

Thanks @Nan-Do
But I'll leave my repository with quants in case anyone needs it

@Rybens sure, that's good.

Thanks @Nan-Do
But I'll leave my repository with quants in case anyone needs it

Just tried out the model in LM Studio. Works very well! I'm impressed!