Spaces:

openaccess-ai-collective

/

ggml-ui

like 4

Build error

Would love to get a community grant to showcase using quantized GGML versions of models in HF Spaces. This will run larger models on the smaller GPUs available. For example quantized 13B models will run on ALL GPU hardware options provided by Spaces, and still run quickly.