--- license: other library_name: transformers tags: - mergekit - merge base_model: - ChaoticNeutrals/Prodigy_7B - Test157t/Prima-LelantaclesV6-7b model-index: - name: Eris_7B results: - task: type: text-generation name: Text Generation dataset: name: AI2 Reasoning Challenge (25-Shot) type: ai2_arc config: ARC-Challenge split: test args: num_few_shot: 25 metrics: - type: acc_norm value: 71.42 name: normalized accuracy source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: HellaSwag (10-Shot) type: hellaswag split: validation args: num_few_shot: 10 metrics: - type: acc_norm value: 87.99 name: normalized accuracy source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: MMLU (5-Shot) type: cais/mmlu config: all split: test args: num_few_shot: 5 metrics: - type: acc value: 65.24 name: accuracy source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: TruthfulQA (0-shot) type: truthful_qa config: multiple_choice split: validation args: num_few_shot: 0 metrics: - type: mc2 value: 66.95 source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: Winogrande (5-shot) type: winogrande config: winogrande_xl split: validation args: num_few_shot: 5 metrics: - type: acc value: 84.21 name: accuracy source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard - task: type: text-generation name: Text Generation dataset: name: GSM8k (5-shot) type: gsm8k config: main split: test args: num_few_shot: 5 metrics: - type: acc value: 66.26 name: accuracy source: url: https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard?query=ChaoticNeutrals/Eris_7B name: Open LLM Leaderboard --- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/GZPRq5YCQO6v8v-aF7CQt.png) # Jeitral: "Eris, the Greek goddess of chaos and discord." Notes: Model should be excellent for both RP/Chat related tasks. Seems to be working in both Alpaca/Chatml. ```Collaborative effort from both @Jeiku and @Nitral involving what we currently felt were our best individual projects.``` We hope you enjoy! - The Chaotic Neutrals. Imatrix GGUF Quants Thanks to @Lewdiculus: https://huggingface.co./Lewdiculous/Eris_7B-GGUF-IQ-Imatrix The following models were included in the merge: * [ChaoticNeutrals/Prodigy_7B](https://huggingface.co./ChaoticNeutrals/Prodigy_7B) * [Test157t/Prima-LelantaclesV6-7b](https://huggingface.co./Test157t/Prima-LelantaclesV6-7b) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: Test157t/Prima-LelantaclesV6-7b layer_range: [0, 32] - model: ChaoticNeutrals/Prodigy_7B layer_range: [0, 32] merge_method: slerp base_model: Test157t/Prima-LelantaclesV6-7b parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: bfloat16 ``` # [Open LLM Leaderboard Evaluation Results](https://huggingface.co./spaces/HuggingFaceH4/open_llm_leaderboard) Detailed results can be found [here](https://huggingface.co./datasets/open-llm-leaderboard/details_ChaoticNeutrals__Eris_7B) | Metric |Value| |---------------------------------|----:| |Avg. |73.68| |AI2 Reasoning Challenge (25-Shot)|71.42| |HellaSwag (10-Shot) |87.99| |MMLU (5-Shot) |65.24| |TruthfulQA (0-shot) |66.95| |Winogrande (5-shot) |84.21| |GSM8k (5-shot) |66.26|