GGML version?
#1
by
IkariDev
- opened
.
GGML: https://huggingface.co./mindrage/Manticore-13B-Chat-Pyg-Guanaco-GGML-q4_0
GPTQ: https://huggingface.co./mindrage/Manticore-13B-Chat-Pyg-Guanaco-GPTQ-4bit-128g.no-act-order.safetensors
:)That is a truly fantastic model btw.
thank you!