| license: apache-2.0 | |
| language: | |
| - en | |
| tags: | |
| - moe | |
| - merge | |
| # Buttercup-4x7B 4bpw | |
| ## Description | |
| Exllama quant of [Kquant03/Buttercup-4x7B-bf16](https://huggingface.co./Kquant03/Buttercup-4x7B-bf16) | |
| ## Other quants: | |
| EXL2: [6bpw](https://huggingface.co./Kooten/Buttercup-4x7B-6bpw-exl2), [5bpw](https://huggingface.co./Kooten/Buttercup-4x7B-5bpw-exl2), [4bpw](https://huggingface.co./Kooten/Buttercup-4x7B-4bpw-exl2) | |
| ## Prompt format: | |
| Unclear.. they do not mention it and at least one of the merged models mentions multiple | |
| ## Contact | |
| Kooten on discord |