Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,002

Full-text search

Active filters: dpo

Wenboz/zephyr-7b-wpo-lora

YYYYYYibo/gshf_ours_1_iter_2

Updated Sep 9 • 12

Magpie-Align/MagpieLM-4B-Chat-v0.1

Text Generation • Updated 16 days ago • 307 • 18

Triangle104/NeuralDaredevil-8B-abliterated-Q4_K_M-GGUF

Updated Sep 9 • 5

Triangle104/NeuralDaredevil-8B-abliterated-Q4_0-GGUF

Updated Sep 9 • 22

Triangle104/NeuralDaredevil-8B-abliterated-Q4_K_S-GGUF

Updated Sep 9 • 1

YYYYYYibo/gshf_ours_1_iter_3

Updated Sep 9 • 5

lewtun/dpo-model-lora

Updated Sep 9 • 4

CharlesLi/OpenELM-1_1B-DPO-full-max-min-reward

Text Generation • Updated Sep 10 • 7

CharlesLi/OpenELM-1_1B-DPO-full-max-random-reward

Text Generation • Updated Sep 9 • 9

CharlesLi/OpenELM-1_1B-DPO-full-least-similar

Text Generation • Updated Oct 3 • 10

taicheng/zephyr-7b-dpo-qlora

Updated Sep 13 • 5

CharlesLi/OpenELM-1_1B-DPO-full-max-reward-least-similar

Text Generation • Updated Oct 3 • 10

dmariko/SmolLM-360M-Instruct-dpo-15k

Updated Sep 12 • 10

QinLiuNLP/llama3-sudo-dpo-instruct-5epochs-0909

Updated Sep 10 • 3

CharlesLi/OpenELM-1_1B-DPO-full-max-reward-most-similar

Text Generation • Updated Oct 3 • 11

CharlesLi/OpenELM-1_1B-DPO-full-most-similar

Text Generation • Updated Oct 3 • 15

DUAL-GPO/phi-2-dpo-chatml-lora-i1

Updated Sep 10 • 2

CharlesLi/OpenELM-1_1B-DPO-full-max-second-reward

Text Generation • Updated Sep 23 • 6

CharlesLi/OpenELM-1_1B-DPO-full-random-pair

Text Generation • Updated Sep 10 • 10

Wenboz/zephyr-7b-dpo-lora

Updated Oct 20 • 9

DUAL-GPO/phi-2-dpo-chatml-lora-10k-30k-i1

Updated Sep 10 • 1

DUAL-GPO/phi-2-dpo-chatml-lora-20k-40k-i1

Updated Sep 10 • 2

LBK95/Llama-2-7b-hf-DPO-LookAhead5_FullEval_TTree1.4_TLoop0.7_TEval0.2_V2.0

Updated Sep 10 • 2

Wenboz/llama3-dpo-lora

DUAL-GPO/phi-2-dpo-chatml-lora-40k-60k-i1

DUAL-GPO/phi-2-dpo-chatml-lora-40k-60k-i2

Updated Sep 11 • 3

NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.01

Text Generation • Updated Sep 11 • 20

vincentlinzhu/dspv1_dpo_dspfmt

NicholasCorrado/zephyr-7b-uf-rc-small-dpo

Text Generation • Updated Sep 11 • 22