heyuan commited on
Commit
798fa33
1 Parent(s): 1343236

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +41 -0
  3. Rose-2x7B-v1.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Rose-2x7B-v1.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - moe
5
+ - frankenmoe
6
+ - merge
7
+ - mergekit
8
+ - uproai/ros-7b-v1
9
+ - WizardLM/WizardMath-7B-V1.1
10
+ base_model:
11
+ - uproai/ros-7b-v1
12
+ - WizardLM/WizardMath-7B-V1.1
13
+ ---
14
+
15
+ # Rose-2x7B-GGUF
16
+
17
+ Rose-2x7B-GGUF is GGUF version of [Rose-2x7B](https://huggingface.co/uproai/Rose-2x7B) which is a Mixure of Experts (MoE) made with the following models using [Mergekit](https://github.com/cg123/mergekit):
18
+ * [maywell/PiVoT-0.1-Starling-LM-RP](https://huggingface.co/maywell/PiVoT-0.1-Starling-LM-RP)
19
+ * [WizardLM/WizardMath-7B-V1.1](https://huggingface.co/WizardLM/WizardMath-7B-V1.1)
20
+
21
+ ## 🧩 Configuration
22
+
23
+ ```yaml
24
+ base_model: uproai/ros-7b-v1
25
+ experts:
26
+ - source_model: maywell/PiVoT-0.1-Starling-LM-RP
27
+ positive_prompts:
28
+ - "storywriting"
29
+ - "write"
30
+ - "scene"
31
+ - "story"
32
+ - "character"
33
+ - source_model: WizardLM/WizardMath-7B-V1.1
34
+ positive_prompts:
35
+ - "reason"
36
+ - "math"
37
+ - "mathematics"
38
+ - "solve"
39
+ - "count"
40
+ tokenizer_source: union
41
+ ```
Rose-2x7B-v1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22eea832aa3e8f1df8b41f3173138b00f2510575f240d45769dbbddf6fc5cd07
3
+ size 13685610400