F16 and F32 quants

#2
by JRZ - opened

Any chance of getting an F16 or F32 quant of this model?

Hi;

This model is based on Llama 3.2 instruct with an imatrix dataset.
This dataset does not transfer to the source, it is applied during quanting that is why there is no "source" version.

Sign up or log in to comment