YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

This repo contains GGUF .mmproj files intended for use in KoboldCpp alongside other GGUF models.

Please pick the correct projector model to load for your architecture (e.g. all Mistral 7B based models should use the Mistral 7B projector.)

Load them in KoboldCpp with --mmproj or from the "Model Files" tab

image/png

When enabled, make sure you refresh KoboldAI Lite, then click Add Img and upload your image. Clicking that image should show Vision is enabled.

Downloads last month
7,813
GGUF
Model size
322M params
Architecture
clip

4-bit

5-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.