A collection of datasets and models used for the Aligning LLMs with Direct Preference Optimization Methods blogpost