metadata
license: apache-2.0
CorticalStack/pastiche-crown-clown-7b-dare-dpo
An EXL2 6.5bpw quantised version of CorticalStack/pastiche-crown-clown-7b-dare-dpo.
An incomplete list of clients and libraries that are known to support EXL2:
- text-generation-webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
- exllamav2, an inference library for running local LLMs on modern consumer GPUs.