Hugging Face's logo

Dracones
/
Midnight-Miqu-70B-v1.0_exl2_2.24bpw

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
1

3.5bpw request

#1
by Gesard - opened
Discussion
Gesard

Hey, wondering if you could do a 3.5bpw.

Dracones
 Owner

Sure. I'll try to have it up later tonight.

Gesard

Thanks!

Dracones
 Owner

This is up now: https://huggingface.co./Dracones/Midnight-Miqu-70B-v1.0_exl2_3.5bpw

Gesard

Thanks!

Dracones changed discussion status to closed

Sign up or log in to comment