README.md

metadata

license: apache-2.0
tags:
  - moe
  - merge
  - mergekit
  - lazymergekit
  - ahxt/LiteLlama-460M-1T
  - llama2

LiteLlamix-8x460M-1T

WIP

I will fine tune this model again. This is just an experiment.