Experimental model quants for https://huggingface.co./Virt-io/Llama-3-8B-Irene-v0.1.
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit