DeusImperator/DeepSeek-R1-Distill-Qwen-32B_exl2_4.5bpw_L Text Generation • Updated 20 days ago • 71 • 1
DeusImperator/DeepSeek-R1-Distill-Qwen-32B_exl2_4.5bpw_L Text Generation • Updated 20 days ago • 71 • 1
DeusImperator/Mistral-Small-Gutenberg-Doppel-22B_exl2_6.8bpw Text Generation • Updated Sep 27, 2024 • 4
Exl2 8bpw MAX quants Collection 8 BPW exl2 quants using modified quantization script to force using best quantization method for each layer for max quality • 10 items • Updated Sep 22, 2024