Update README.md

README.md

@@ -1 +1,103 @@
-platypus is inside
+---
+license: other
+license_name: yi-license
+license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
+tags:
+- yi
+- moe
+---
+
+
+# Helion-4x34B
+
+This is the model for Helion-4x34B. I used [mergekit](https://github.com/cg123/mergekit) to make this MOE model.
+
+# Prompt Template(s):
+
+Since [bagel-dpo-34b-v0.2](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2) uses many prompt templates, you can utilize prompt templates provided by bagel and other expert's prompt templates.
+
+**Note:** I currently do not know which prompt template is best.
+
+### ChatML:
+
+```
+<|im_start|>system
+{system}<|im_end|>
+<|im_start|>user
+{user}<|im_end|>
+<|im_start|>assistant
+{asistant}<|im_end|>
+```
+
+### Human Asistant
+
+```
+Human: {user}
+
+### Assistant: {asistant}
+```
+
+### Alpaca (sort of)
+
+```
+Below is an instruction that describes a task.  Write a response that appropriately completes the request.
+
+### Instruction:
+{system}
+{instruction}
+
+### Response:
+```
+
+### Vicuna
+
+```
+{system}
+USER: {instruction}
+ASSISTANT: 
+```
+
+Visit [bagel-dpo-34b-v0.2](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2) to try more prompt templates. 
+
+# Yaml Config to reproduce
+
+```yaml
+base_model: nontoxic-bagel-34b-v0.2
+gate_mode: hidden
+dtype: bfloat16
+
+experts:
+  - source_model: bagel-dpo-34b-v0.2
+    positive_prompts: ["question answering", "Q:", science", "biology", "chemistry", "physics"]
+    negative_prompts: ["math", "reason", "mathematics", "solve", "count", "code", "python", "javascript", "programming", "algorithm"]
+
+  - source_model: Nous-Hermes-2-Yi-34B
+    positive_prompts: ["chat", "math", "reason", "mathematics", "solve", "count", "python", "javascript", "programming", "algorithm", "tell me", "assistant"]
+
+  - source_model: SUS-Chat-34B
+    positive_prompts: ["math", "reason", "mathematics", "solve", "count", "assistant"]
+
+  - source_model: platypus-yi-34b
+    positive_prompts: [""]
+    negative_prompts: ["math", "reason", "mathematics", "solve", "count"]
+```
+
+# Quantizationed versions
+
+Quantizationed versions of this model is available thanks to [TheBloke](https://hf.co/TheBloke).
+
+##### GPTQ
+
+- [TheBloke/Helion-4x34B-GPTQ](https://huggingface.co/TheBloke/Helion-4x34B-GPTQ)
+
+##### GGUF
+
+- [TheBloke/Helion-4x34B-GGUF](https://huggingface.co/TheBloke/Helion-4x34B-GGUF)
+
+##### AWQ
+
+- [TheBloke/Helion-4x34B-AWQ](https://huggingface.co/TheBloke/Helion-4x34B-AWQ)
+
+If you would like to support me:
+
+[☕ Buy Me a Coffee](https://www.buymeacoffee.com/weyaxi)