Quantized version of https://huggingface.co./Snowflake/snowflake-arctic-instruct

Created from commit be318cae5aba5291208f27d30991a5150500887d. The original model was changed due to fixes for GQA support, so I decided to convert it again.

Downloads last month
7
GGUF
Model size
479B params
Architecture
arctic

2-bit

3-bit

4-bit

5-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .