Quantized GGUF models
#1
by
bullerwins
- opened
Hi!
If anyone wants to use the GGUF quantized version to use with llama.cpp I have uploaded them here:
https://huggingface.co./bullerwins/Athene-70B-GGUF