awsuineg commited on
Commit
d850baf
·
verified ·
1 Parent(s): 982233d

End of training

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -1,17 +1,20 @@
1
  ---
2
  base_model: mistralai/Mistral-7B-v0.1
 
 
3
  library_name: transformers
4
- model_name: zephyr-orpo-7b-hehe
5
  tags:
6
  - generated_from_trainer
 
7
  - trl
8
  - orpo
9
  licence: license
10
  ---
11
 
12
- # Model Card for zephyr-orpo-7b-hehe
13
 
14
- This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
  base_model: mistralai/Mistral-7B-v0.1
3
+ datasets:
4
+ - HuggingFaceH4/ultrafeedback_binarized
5
  library_name: transformers
6
+ model_name: mistralai/Mistral-7B-v0.1
7
  tags:
8
  - generated_from_trainer
9
+ - alignment-handbook
10
  - trl
11
  - orpo
12
  licence: license
13
  ---
14
 
15
+ # Model Card for mistralai/Mistral-7B-v0.1
16
 
17
+ This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the [['HuggingFaceH4/ultrafeedback_binarized']](https://huggingface.co/datasets/['HuggingFaceH4/ultrafeedback_binarized']) dataset.
18
  It has been trained using [TRL](https://github.com/huggingface/trl).
19
 
20
  ## Quick start