tiiuae

/

falcon-mamba-7b-instruct

like 67

Follow

Technology Innovation Institute 1.08k

There is an open issue to add FalconMamba support for GGUF: https://github.com/ggerganov/llama.cpp/issues/9009, we will push GGUF models as soon as there is a llama.cpp support for this architecture!

llama.cpp support is coming soon :) https://github.com/ggerganov/llama.cpp/pull/9074

We just added GGUF support, please check out all checkpoints here: https://huggingface.co./collections/tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a