Olivier's picture

6 1 18

Olivier

oliviermills

·

https://oliviermills.com

AI & ML interests

LLMs, Data, AI for non-profits

Recent Activity

reacted to lewtun's post with 🔥 about 1 month ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

replied to lewtun's post about 1 month ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

liked a dataset 8 months ago

Salesforce/xlam-function-calling-60k

View all activity

Organizations

oliviermills's activity

New activity in mPLUG/TinyChart-3B-768 10 months ago

model card? ollama?

#1 opened 10 months ago by

New activity in BAAI/bge-reranker-base 11 months ago

Languages covered?

#16 opened 11 months ago by

New activity in meta-llama/Meta-Llama-3-8B-Instruct 11 months ago

Non-English language capabilities

#2 opened 11 months ago by

New activity in HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1 11 months ago

Context window?

#10 opened 11 months ago by

commented a paper 12 months ago

DocLLM: A layout-aware generative language model for multimodal document understanding

Paper • 2401.00908 • Published Dec 31, 2023 • 180 •

New activity in CohereForAI/aya-101 about 1 year ago

Aya as a translation tool?

#15 opened about 1 year ago by

commented a paper about 1 year ago

DocLLM: A layout-aware generative language model for multimodal document understanding

Paper • 2401.00908 • Published Dec 31, 2023 • 180 •