Cannot run by vllm

by Dayubian - opened 13 days ago

13 days ago

When run by vllm, it got error below:
ValueError: The checkpoint you are trying to load has model type llava_cohere but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

nahidalam

Maya: Multilingual Multimodal model org 13 days ago

Hi @Dayubian we do not support vllm yet.

kkr5155

Maya: Multilingual Multimodal model org 10 days ago

Thank you @Dayubian for bringing this to our attention, as Nahid mentioned we are not supporting VLLM at the moment.
Please watch the community page for further updates.

kkr5155

Maya: Multilingual Multimodal model org 10 days ago

I'm closing this discussion for now.

kkr5155 changed discussion status to closed 10 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment