-
AmberYifan/llama2-7b-sft-ultrachat-safeRLHF
Text Generation • Updated • 115 -
AmberYifan/mistral-v0.1-7b-sft-ultrachat-safeRLHF
Text Generation • Updated • 76 -
AmberYifan/Mistral-7B-v0.3-sft-ultrachat-safeRLHF
Text Generation • Updated • 115 -
AmberYifan/Gemma-2-9B-sft-ultrachat-safeRLHF
Text Generation • Updated • 12
Yifan Wang
AmberYifan
AI & ML interests
None yet
Recent Activity
updated
a model
16 minutes ago
AmberYifan/Llama-2-7b-sft-human-rm
published
a model
about 1 hour ago
AmberYifan/Llama-2-7b-sft-human-rm
updated
a model
about 1 hour ago
AmberYifan/Mistral-7B-v0.3-sft-human-rm
Organizations
Collections
2
This collection contains safetyQA dataset for safe SPIN training and trained models
models
281
AmberYifan/Llama-2-7b-sft-human-rm
Updated
AmberYifan/Mistral-7B-v0.3-sft-human-rm
Text Generation
•
Updated
AmberYifan/Llama-2-7b-sft-spin-simPO-10k
Updated
AmberYifan/Llama-2-7b-sft-SPIN-length-70-10k
Text Generation
•
Updated
•
19
AmberYifan/Llama-2-7b-sft-SPIN-cleaned-10k
Text Generation
•
Updated
•
21
AmberYifan/Qwen2.5-7B-sft-harmful-hhrlhf-spin
Text Generation
•
Updated
•
12
AmberYifan/Qwen2.5-7B-sft-harmful-hhrlhf-gen-dpo
Text Generation
•
Updated
•
22
AmberYifan/Qwen2.5-7B-sft-harmful-hhrlhf-dpo
Text Generation
•
Updated
•
9
AmberYifan/Qwen2-7B-sft-harmful-hhrlhf-spin
Text Generation
•
Updated
•
9
AmberYifan/Qwen2-7B-sft-harmful-hhrlhf-gen-dpo
Text Generation
•
Updated
•
21
datasets
25
AmberYifan/mistral-v0.1-spin-hhrlhf
Viewer
•
Updated
•
5.5k
•
32
AmberYifan/sft-spin-filter
Updated
•
1
AmberYifan/sft-spin-kcenter-5k
Viewer
•
Updated
•
5.5k
•
32
AmberYifan/gsm8k-sft
Viewer
•
Updated
•
8.79k
•
15
AmberYifan/sft-spin-v
Viewer
•
Updated
•
50.5k
•
16
AmberYifan/safeRLHF-SFT
Viewer
•
Updated
•
83.4k
•
12
AmberYifan/SPIN-trans-DPOformat
Viewer
•
Updated
•
55k
•
27
AmberYifan/spin-v-diverse
Viewer
•
Updated
•
55k
•
18
AmberYifan/dpo-v
Viewer
•
Updated
•
55k
•
22
AmberYifan/spin-v
Viewer
•
Updated
•
55k
•
29