Base PR: https://github.com/ggerganov/llama.cpp/pull/5267 
Note: integration in llama.cpp is partial at this point - it uses llava-1.5 preprocessing