README.md

metadata

base_model:
  - huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated
library_name: transformers
tags:
  - abliterated
  - uncensored
pipeline_tag: text-generation

Exllamav2 Quantized Version of huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated

Use the measurement.json file to craft different quantized versions.

huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated

This is an uncensored version of deepseek-ai/DeepSeek-R1-Distill-Llama-70B created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/deepseek-r1-abliterated directly

ollama run huihui_ai/deepseek-r1-abliterated:70b