When this fp8 version coming?
#1
by
ryg81
- opened
Hey I have seen the bf16 version demos, it looks amazing. I wanted to try it out but my system not good enough for it, is it possible to get the fp8 version or GGUF under 7 GB size? If so thanks in advance.
We find that we do not need to update a fp8 version. It can be converted automatically in ComfyUI: https://github.com/IamCreateAI/Ruyi-Models/blob/main/comfyui/comfyui_nodes.py#L56
@happynear Not all can do that as it requires computational power, so it would be great if that gets done and uploaded by someone with good system GPU.