--- base_model: - DevQuasar/llama3_8b_chat_brainstorm-v2.1 - Hastagaras/Halu-8B-Llama3-Blackroot - Hastagaras/Jamet-8B-L3-MK.V-Blackroot library_name: transformers tags: - mergekit - merge --- # humanity.a [GGUFs](https://huggingface.co./kromquant/L3-Ceto-Epith-Humanity.A-v0.1-8B-GGUFs) ## Merge Details ### Merge Method This model was merged using the linear [DARE](https://arxiv.org/abs/2311.03099) merge method using [DevQuasar/llama3_8b_chat_brainstorm-v2.1](https://huggingface.co./DevQuasar/llama3_8b_chat_brainstorm-v2.1) as a base. ### Models Merged The following models were included in the merge: * [Hastagaras/Halu-8B-Llama3-Blackroot](https://huggingface.co./Hastagaras/Halu-8B-Llama3-Blackroot) * [Hastagaras/Jamet-8B-L3-MK.V-Blackroot](https://huggingface.co./Hastagaras/Jamet-8B-L3-MK.V-Blackroot) ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: DevQuasar/llama3_8b_chat_brainstorm-v2.1 dtype: float32 merge_method: dare_linear out_dtype: bfloat16 parameters: int8_mask: 1.0 normalize: 0.0 slices: - sources: - layer_range: [0, 32] model: Hastagaras/Halu-8B-Llama3-Blackroot parameters: weight: 0.65 - layer_range: [0, 32] model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot parameters: weight: 0.65 - layer_range: [0, 32] model: DevQuasar/llama3_8b_chat_brainstorm-v2.1 tokenizer_source: base ```