cmp-nct

/

llava-1.6-gguf

like 73

I don't think VLLM can inference those binaries, gguf is the ggml/llama.cpp format

This is for vision LLMs, not the vllm library, we'll change the wording to be clearer