GGML demo
#6
by
matthoffner
- opened
I've put together a demo using a quantized ggml version from @TheBloke running on a CPU upgrade space:
API: https://huggingface.co./spaces/matthoffner/starchat-ggml
UI: https://huggingface.co./spaces/matthoffner/starchat-ui
Awesome work @matthoffner !!
Very nice!I have linked them in the README of my GGML repo
matthoffner
changed discussion status to
closed
i am getting errors when trying to build https://huggingface.co./spaces/matthoffner/starchat-ggml