unsloth
/

Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Strange behaviour of Llama3.2-vision - it behaves like text model

#9 opened about 2 months ago by

How to use it in ollama

#8 opened about 2 months ago by

Exporting to GGUF

#7 opened 2 months ago by

krasivayakoshka

Training with images

#6 opened 3 months ago by

AttributeError: Model MllamaForConditionalGeneration does not support BitsAndBytes quantization yet.

#5 opened 3 months ago by

How much vram needed?

#4 opened 4 months ago by

How load this model?

#3 opened 4 months ago by

Can you post the script that was used to quantize this model please?

#2 opened 5 months ago by

ctranslate2-4you