Hugging Face's logo

unsloth
/
Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text
Transformers
Safetensors
PyTorch
English
mllama
llama-3
llama
meta
facebook
unsloth
multimodal
vision
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
9

How to use it in ollama

#8
by vejahetobeu - opened
Discussion
vejahetobeu

hi,I would like to ask how to use it in ollama
use "llama.cpp/convert_hf_to_gguf.py" error: ERROR:hf-to-gguf:Model MllamaForConditionalGeneration is not supported
image.png

Directly from this directory in ollama
(Error: unsupported architecture)
image.png

shimmyshimmer
 Unsloth AI org

hi,I would like to ask how to use it in ollama
use "llama.cpp/convert_hf_to_gguf.py" error: ERROR:hf-to-gguf:Model MllamaForConditionalGeneration is not supported
image.png

Directly from this directory in ollama
(Error: unsupported architecture)
image.png

You will need Bitsandbytes as well

Sign up or log in to comment