Advancing Open-source Language Models with Mixed-Quality Data

Online Demo | GitHub | Paper | Discord

OpenChat is dedicated to advancing and releasing open-source language models, fine-tuned with our C-RLFT technique, which is inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, which we were the first to beat with only 7B parameter LLMs which can be run on a consumer GPU (e.g. RTX 3090).

💌Contact

Project Lead:

• Guan Wang [[email protected]]
• Alpay Ariyak [[email protected]]

Sponsors:

• Sen Song (Tsinghua University)
• Yang Liu (Tsinghua University)
• 01.AI Company
• RunPod