Qwen

/

Qwen2-VL-7B-Instruct-GPTQ-Int8

like 19

Follow

Qwen 7.36k

Hello ,

Is there a docker image we can use for the Quantized (8/4) model that can run on CPU VM ? If not please help as the Model import is failing although all dependencies are installed. Thanks