4 bit GPTQ

#1
by flashvenom - opened

In progress and will be uploaded shortly (or probably already done by the time you read this)

@TheBloke the origin model is updated to a earlier checkpoint, would you like to convert it again?

update 2023-06-25 - re-uploaded with a slightly earlier checkpoint, which seems perhaps a little less overfit than the full 3-epochs version initially uploaded

jondurbin changed discussion status to closed

Sign up or log in to comment