Issue Loading Llama-3.2 (11B) Vision Instruct Model in Colab

#3
by Sampas - opened

Hello Unslooth Team,

I am attempting to load the Llama-3.2 (11B)-Vision-Instruct model in Colab, but I am encountering the following error:

RuntimeError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this model type.

Could you please confirm if this model is supported on Colab, or if there are specific configurations or dependencies I might be missing? I have updated the necessary libraries, but the issue persists.

I would appreciate your assistance in resolving this.

Best regards,
[Enes Tura]

Hey guys apologies for the delays. Vision models are now supported! :)

Read our blogpost: https://unsloth.ai/blog/vision
Tweet: https://x.com/UnslothAI/status/1859667930075758793
GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024

is there any update on this?

Unsloth AI org

is there any update on this?

Still in the works - apologies.

hello , is there any update on this model ? or can you please inform me whenever the update model comes...

Unsloth AI org

hello , is there any update on this model ? or can you please inform me whenever the update model comes...

Yes we will let you guys know once it's supported so we can update all the model cards many thanks!

thank you :)

Hello, is there any progress?

Hello, is there any progress ?

Yes. It's done and ready to go but we need to announce it so this week for sure! :) I will notify you all

Hello, is there any progress ?

Hello, is there any progress?

Hello Unslooth Team,

I am attempting to load the Llama-3.2 (11B)-Vision-Instruct model in Colab, but I am encountering the following error:

RuntimeError: The checkpoint you are trying to load has model type `mllama` but Transformers does not recognize this model type.

Could you please confirm if this model is supported on Colab, or if there are specific configurations or dependencies I might be missing? I have updated the necessary libraries, but the issue persists.

I would appreciate your assistance in resolving this.

Best regards,
[Enes Tura]

is there any update on this?

Hey guys apologies for the delays. Vision models are now supported! :)

Read our blogpost: https://unsloth.ai/blog/vision
Tweet: https://x.com/UnslothAI/status/1859667930075758793
GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024

Thank you for the update, do I have a chance to fine-tune the 11 billion instruction version of the llama3.2 model? I don't want to do image processing. I just want to fine-tune it for the Turkish language using unsloth.

Unsloth AI org

Thank you for the update, do I have a chance to fine-tune the 11 billion instruction version of the llama3.2 model? I don't want to do image processing. I just want to fine-tune it for the Turkish language using unsloth.

Yes of course we allow you to do that. You can fine-tune the image and language part separately.

Sign up or log in to comment