unable to use custom inference endpoint

by HonestAnnie - opened Sep 9

Sep 9

"The checkpoint you are trying to load has model type gemma2 but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date."

x-one-poznan

Sep 11

•

edited Sep 11

Perhaps a requirements.txt with a specified transformers version could fix it?

transformers>=4.44.0

Reference: https://huggingface.co./docs/inference-endpoints/guides/custom_dependencies

I've created a PR: https://huggingface.co./BAAI/bge-multilingual-gemma2/discussions/11

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment