altomek
/

romulus-mistral-nemo-12b-simpo-8bpw-EXL2

Text Generation

Generated from Trainer

text-generation-inference

8-bit precision

Model card Files Files and versions Community

romulus-mistral-nemo-12b-simpo

ExLlamav2 8 bpw quants of https://huggingface.co./axolotl-ai-co/romulus-mistral-nemo-12b-simpo

Downloads last month: 7

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/romulus-mistral-nemo-12b-simpo-8bpw-EXL2

Base model

winglian/m12b-20240721-test010

Finetuned

axolotl-ai-co/romulus-mistral-nemo-12b-simpo

Quantized

(8)

this model

Evaluation results

Metadata error: specify a dataset to view leaderboard