Hugging Face's logo

AzureBlack
/
airoboros-l2-70b-2.2.1-5bpw-6h-exl2

Text Generation
Transformers
PyTorch
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
2

Can you please create a 3 bit?

#1
by Kotokin - opened
Discussion
Kotokin

Can you please create a 3 bit?

AzureBlack
 Owner

https://huggingface.co./AzureBlack/airoboros-l2-70b-2.2.1-3bit-exl2

Kotokin

Thank you very much for your work

Kotokin changed discussion status to closed

Sign up or log in to comment