A collection of models quantized in AutoRound format using Intel AutoRound, INT4, groupsize 128
-
fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-asym
Text Generation • Updated • 6 -
fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-sym
Text Generation • Updated • 5 -
fbaldassarri/EleutherAI_pythia-6.9b-autoround-int4-gs128-asym
Text Generation • Updated • 9 -
fbaldassarri/EleutherAI_pythia-6.9b-autoround-int4-gs128-sym
Text Generation • Updated • 10