DevQuasar/Qwen.Qwen2-VL-7B-Instruct-GGUF

Sample use wit llama.cpp

build/bin/llama-qwen2vl-cli -m ../Qwen.Qwen2-VL-7B-Instruct-GGUF/Qwen2.5-7b-instruct-Q8_0.gguf --mmproj ../Qwen.Qwen2-VL-7B-Instruct-GGUF/qwen.qwen2-vl-7b-instruct-vision.gguf  -p "Describe this image." --image ~/test_img.jpg

Build llama-qwen2vl-cli

cmake --build build --config Release --target llama-qwen2vl-cli

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/