README.md

---
license: apache-2.0
language:
- en
tags:
- moe
- merge
---

# Buttercup-4x7B 4bpw

## Description
Exllama quant of [Kquant03/Buttercup-4x7B-bf16](https://huggingface.co./Kquant03/Buttercup-4x7B-bf16)

## Other quants:
EXL2: [6bpw](https://huggingface.co./Kooten/Buttercup-4x7B-6bpw-exl2), [5bpw](https://huggingface.co./Kooten/Buttercup-4x7B-5bpw-exl2), [4bpw](https://huggingface.co./Kooten/Buttercup-4x7B-4bpw-exl2)

## Prompt format:
Unclear.. they do not mention it and at least one of the merged models mentions multiple

## Contact
Kooten on discord