quantize the model into 4bits

by SylvainV - opened 28 days ago

28 days ago

Hello,
Thank you for your work.
I'd like to know what method you used to quantify the 4-bit model?

Best regards,

SylvainV changed discussion title from 4bits to quantize the model into 4bits 28 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment