Wrong automatic detection of nb of parameters & precision (dataset card bug)

#5
by Jeronymous - opened

image.png

This is wrong (screenshot from the dataset card).
That model has 6.7 B parameter, with a precision of 4 bits.

I guess there is a wrong assumption that the precision is float 16, and then the estimation of the number of parameters goes wrong (looking at the file size ?).
I wonder whether it can be fixed by adding something in the yaml header

Pruna AI org

Good point! We will ask Hugging Face. It is atm not clear from the model card doc.

After discussing with HF team, the parameter count function should be here. The error might be related to metadata in the safe tensors. It feels that the tensor type is wrongly inferred.

Sign up or log in to comment