13B quantization
#1
by
samgreen
- opened
Hi. A 13B version of ShareGPT4V was released earlier today. Nobody seems to have quantized it so far. Any chance you'd be able to do it?
I also would like someone to upload a 13B gguf for this model please!
Thank you for helping the cimmunity by uploading gguf's!
Hey, I uploaded it here: https://huggingface.co./nakodanei/ShareGPT4V-13B_GGUF
Could you also please quant 13B model to Q8 gguf for my 3090?