Abliterated version of Qwen/Qwen2.5-72B-Instruct, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

Model size

72.7B params

Architecture

qwen2

3-bit

4-bit

6-bit

Inference Examples

Unable to determine this model's library. Check the docs .

Model tree for zetasepic/Qwen2.5-72B-Instruct-abliterated-GGUF

Base model

Qwen/Qwen2.5-72B

Finetuned

Quantized

(68)

this model