BioMEd / README.md
SamariTanOG's picture
Upload folder using huggingface_hub
1065836 verified
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - epfl-llm/meditron-7b

BioMEd

BioMEd is a merge of the following models using mergekit:

🧩 Configuration

```yaml models:

  • model: BioMistral/BioMistral-7B-DARE

  • model: epfl-llm/meditron-7b parameters: density: 0.53 weight: 0.4

merge_method: dare_ties base_model: BioMistral/BioMistral-7B-DARE parameters: int8_mask: true dtype: bfloat16 ```