Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
|
9 |
|
10 |
this is a DPO fine-tuned MoE model with 60B parameter.
|
11 |
|
12 |
-
|
13 |
```
|
14 |
DPO Trainer
|
15 |
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
|
|
|
9 |
|
10 |
this is a DPO fine-tuned MoE model with 60B parameter.
|
11 |
|
12 |
+
|
13 |
```
|
14 |
DPO Trainer
|
15 |
TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
|