metadata
license: apache-2.0
"It seems that all eukaryotic cells either have, or once had (and then lost) mitochondria." - Nick Lane
My first 8x7B frankenMoE...aimed to incorporate everything I've learned, so far. An evolution of my content, if you will.
Models used:
- SanjiWatsuki/Kunoichi-DPO-v2-7B - router
- argilla/distilabeled-Marcoro14-7B-slerp - expert #1
- argilla/distilabeled-Marcoro14-7B-slerp - expert #2
- abideen/NexoNimbus-7B - expert #3
- mlabonne/NeuralDaredevil-7B - expert #4
- senseable/garten2-7b - expert #5
- SanjiWatsuki/Kunoichi-DPO-v2-7B - expert #6
- SanjiWatsuki/Kunoichi-DPO-v2-7B - expert #7
- SanjiWatsuki/Lelantos-DPO-7B - expert #8