Update GGUF to latest and also 8bit / 4bit

#36

by ssmits - opened Sep 25

Sep 25

Hi, thank you for creating this amazing model.
Would you mind updating the GGUF models to the latest version? This way I can compare the 8-bit and 4-bit performance to the original fp16. Thanks again!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment