Sample use wit llama.cpp
build/bin/llama-qwen2vl-cli -m ../Qwen.QVQ-72B-Preview-GGUF/Q8/QVQ-72B-Preview-Q8_0-00001-of-00006.gguf --mmproj ../Qwen.QVQ-72B-Preview-GGUF/qwen.qvq-72b-preview-vision.gguf -p "Describe this image." --image ~/test_img.jpg
Build llama-qwen2vl-cli
cmake --build build --config Release --target llama-qwen2vl-cli
I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.
If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar
Also feel free to visit my website https://devquasar.com/
- Downloads last month
- 8