Update README.md

README.md

@@ -1,13 +1,19 @@
 ---
-library_name: transformers
-tags: []
+license: cc-by-nc-4.0
+base_model: mlabonne/Beagle14-7B
+tags:
+- merge
+- mergekit
+- lazymergekit
+- dpo
+- rlhf
+- rlaif
+- distilabel
 ---
 
 # Model Card for Model ID
 
-<!-- Provide a quick summary of what the model is/does. -->
-
-
+This is a preference tuned version of `mlabonne/Beagle14-7B` using a mix of Argilla's orca pairs and a new upcoming multi-turn dpo dataset.
 
 ## Model Details
 
@@ -17,13 +23,11 @@ tags: []
 
 This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
+- **Developed by:** Argilla
 - **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
+- **Language(s) (NLP):** English
+- **License:** cc-by-nc-4.0
+- **Finetuned from model [optional]:** mlabonne/Beagle14-7B
 
 ### Model Sources [optional]