Intel

/

Meta-Llama-3.1-8B-Instruct-int4-inc

like 2

Follow

Intel 1,968

Hi, my understanding is that main.py in https://github.com/intel/auto-round/blob/main/examples/language-modeling/main.py can be used with meta-llama 3.1 model to convert to int4 using steps in Model card.

I see. It's just that other int4 quantized models have all weights uploaded so I thought this was going to be the same way.

I see. It's just that other int4 quantized models have all weights uploaded so I thought this was going to be the same way.

Apologize for the inconvenience. Due to our quite lengthy review process, we typically only allow the recipe to be uploaded. You can use the recipe to generate the model yourself.