General discussion.
#1
by
Lewdiculous
- opened
Added Quants:
Eris_7B-Q4_K_M-imatrix.gguf
Eris_7B-Q4_K_S-imatrix.gguf
Eris_7B-IQ4_NL-imatrix.gguf
Eris_7B-IQ4_XS-imatrix.gguf (supported in koboldcpp 1.60 or higher)
Eris_7B-Q5_K_M-imatrix.gguf
Eris_7B-Q5_K_S-imatrix.gguf
Eris_7B-Q6_K-imatrix.gguf
Eris_7B-Q8_0-imatrix.gguf
Eris_7B-IQ3_M-imatrix.gguf
Eris_7B-IQ3_S-imatrix.gguf (supported in koboldcpp 1.59.1 or higher)
Eris_7B-IQ3_XS-imatrix.gguf
Eris_7B-IQ3_XXS-imatrix.gguf
https://huggingface.co./Lewdiculous/Eris_7B-GGUF-IQ-Imatrix