TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF · Discussions

Resources

View closed (0)

is this filtered or unfiltered can it run on my 3090?

#4 opened 10 months ago by

32k ctx doesn't work on this model for GGUF

#3 opened 10 months ago by

Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.

#2 opened 11 months ago by

Requesting IQ2_XXS and IQ2_XS quants.

#1 opened 11 months ago by