Support state-spaces/mamba?

by hackeys - opened Jul 21

Jul 21

Please add the ability to use https://github.com/state-spaces/mamba
Readme says it can be launched via state-spaces/mamba. However, state-spaces/mamba complains about the tokenizer and the lack of a config.jsion file.

Molbap

Jul 24

Hey @hackeys , have you tried running the weights through mistral-inference?

hackeys

Jul 24

Hey @hackeys , have you tried running the weights through mistral-inference?

I would love to try this wonderful tool, but apparently it doesn't work with AMD's ROCM. I'm using two 7900xtx. If I'm wrong, I'll be glad to receive instructions on how to run it.

hackeys

Jul 25

Dear developers from Mistral! We kindly ask you to show an example for running this model at https://github.com/state-spaces/mamba.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment