File size: 559 Bytes
1c703ca |
1 2 3 4 5 6 7 8 9 |
---
license: apache-2.0
datasets:
- adamo1139/uninstruct-v1-experimental-chatml
---
## Basic Model Info
1 epoch on adamo1139/uninstruct-v1-experimental-chatml. I used [GaLore](https://arxiv.org/abs/2403.03507).\
Purpose of this model is to make the model un-learn to use chatml-specific code words such as: <|im_start|>, <|im_end|>, user, assistant.
This is a base model meant for further finetuning. I think much of OpenAI slop is still left in there, so it's probably best combined with preference optimization method like DPO, ORPO or SPO for best results. |