DPO LoRA Merge into base

#14
by christopherthompson81 - opened

I attempted to merge the DPO adaptor that's included as a folder, but got the error "afetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge" from PEFT, which appears to mean there's a mismatch between the base and the adaptor files. Was this already merged in, or is there something special I need to do?

NousResearch org

It was merged with axolotl, I'm not sure what other engines do

teknium changed discussion status to closed

Sign up or log in to comment