Spaces:
Running
on
A10G
Running
on
A10G
Completely incoherent model when converted Gemma 2 to IQ3_M with Imatrix file
#107
by
Dampfinchen
- opened
"Mh giàu され rodas reliablyacheteurδε Są" output.
I've used my own imatrix file and tried to convert princeton-nlp/gemma-2-9b-it-SimPO. Inference program and parameters same as always, models by bartowski, michael radermacher etc work.
This comment has been hidden
Can be closed, was the inference program after all. Model works.
Dampfinchen
changed discussion status to
closed