Triangle104 commited on
Commit
f3981c5
·
verified ·
1 Parent(s): a4bfdfa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md CHANGED
@@ -13,6 +13,57 @@ tags:
13
  This model was converted to GGUF format from [`SubtleOne/Rombos-Qwen2.5-Writer-32b`](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) for more details on the model.
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Use with llama.cpp
17
  Install llama.cpp through brew (works on Mac and Linux)
18
 
 
13
  This model was converted to GGUF format from [`SubtleOne/Rombos-Qwen2.5-Writer-32b`](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) for more details on the model.
15
 
16
+ ---
17
+ Model details:
18
+ -
19
+ This model is a merge using Rombos's top-ranked 32b model, based on
20
+ Qwen 2.5, and merging three creative writing finetunes. The creative
21
+ content is a serious upgrade over the base it started with, and I
22
+ enjoyed it in my DnD RPG campaign.
23
+
24
+ Merge
25
+
26
+ This is a merge of pre-trained language models created using mergekit.
27
+
28
+ Merge Method
29
+
30
+ This model was merged using the DELLA merge method using Rombos-LLM-V2.5-Qwen-32b as a base.
31
+
32
+ Models Merged
33
+
34
+ The following models were included in the merge:
35
+
36
+ EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
37
+ allura-org/Qwen2.5-32b-RP-Ink
38
+ nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
39
+
40
+ Configuration
41
+
42
+ The following YAML configuration was used to produce this model:
43
+
44
+ base_model: rombodawg/Rombos-LLM-V2.5-Qwen-32b
45
+ parameters:
46
+ int8_mask: true
47
+ rescale: false
48
+ normalize: true
49
+ dtype: bfloat16
50
+ tokenizer_source: union
51
+ merge_method: dare_ties
52
+ models:
53
+ - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
54
+ parameters:
55
+ weight: [0.4]
56
+ density: [0.55]
57
+ - model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
58
+ parameters:
59
+ weight: [0.3]
60
+ density: [0.55]
61
+ - model: allura-org/Qwen2.5-32b-RP-Ink
62
+ parameters:
63
+ weight: [0.4]
64
+ density: [0.55]
65
+
66
+ ---
67
  ## Use with llama.cpp
68
  Install llama.cpp through brew (works on Mac and Linux)
69