How come the model is only 3GB?
#1
by
nouamanetazi
HF staff
- opened
If this model is fine-tuned from https://huggingface.co./openai/whisper-large-v2 , and the latter is 6GB
Why is the pytorch_model.bin in this repo only 3GB? 🤔
Great job btw!
cc @Zaid
We used deepspeed for training this model. The reduction in size might ve due to the optmiziation.