WizardLM 70B V1.0 โ bfloat16 (BF16)
- Model creator: WizardLM
- Original model: WizardLM 70B V1.0
Conversion process:
Use the following script to convert your local pytorch_model bin files to bfloat16 + safetensors all in one go:
- https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py (best for sharding and float16/FP16 or bfloat16/BF16 conversion)
Example to convert WizardLM 70B V1.0 directly to bfloat16 safetensors in 10GB shards:
python convert-to-safetensors.py --bf16 ~/original/WizardLM-70B-V1.0 --output ~/float16_safetensored/WizardLM-70B-V1.0-BF16 --max-shard-size 10GB
- Downloads last month
- 15