alkinun's picture

alkinun

AtAndDev

·

AI & ML interests

LLMs, Alignment, Merging, Unsloth, DPO, SFT, ORPO, SPIN..

Recent Activity

liked a model 3 days ago

briaai/RMBG-2.0

liked a Space 3 days ago

not-lain/background-removal

reacted to InferenceIllusionist's post with 🔥 4 days ago

MilkDropLM-32b-v0.3: Unlocking Next-Gen Visuals ✨ Stoked to release the latest iteration of our MilkDropLM project! This new release is based on the powerful Qwen2.5-Coder-32B-Instruct model using the same great dataset that powered our 7b model. What's new? - Genome Unlocked: Deeper understanding of preset relationships for more accurate and creative generations. - Preset Revival: Breathe new life into old presets with our upgraded model! - Loop-B-Gone: Say goodbye to pesky loops and hello to smooth generation. - Natural Chats: Engage in more natural sounding conversations with our LLM than ever before. Released under Apache 2.0, because sharing is caring! Try it out: https://huggingface.co./InferenceIllusionist/MilkDropLM-32b-v0.3 Shoutout to @superwatermelon for his invaluable insights and collab, and to all those courageous members in the community that have tested and provided feedback before!

View all activity

Organizations

AtAndDev's activity

upvoted a paper 4 days ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20 • 86

upvoted a paper 10 days ago

Phi-4 Technical Report

Paper • 2412.08905 • Published 13 days ago • 92

upvoted a paper 11 days ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 87

upvoted a paper 13 days ago

KTO: Model Alignment as Prospect Theoretic Optimization

Paper • 2402.01306 • Published Feb 2 • 16

upvoted a collection 16 days ago

NuminaMath

Datasets and models for training SOTA math LLMs. See our GitHub for training & inference code: https://github.com/project-numina/aimo-progress-prize • 6 items • Updated Jul 21 • 67

upvoted a paper 21 days ago

Large Language Models Can Self-Improve in Long-context Reasoning

Paper • 2411.08147 • Published Nov 12 • 62

upvoted a paper 24 days ago

O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?

Paper • 2411.16489 • Published 30 days ago • 40

upvoted a collection 26 days ago

🧠 Reasoning Models

6 items • Updated about 13 hours ago • 33

upvoted a collection 27 days ago

QwQ

Qwen with Questions • 2 items • Updated 27 days ago • 47

upvoted 4 papers about 1 month ago

Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

Paper • 2403.09629 • Published Mar 14 • 75

V-STaR: Training Verifiers for Self-Taught Reasoners

Paper • 2402.06457 • Published Feb 9 • 9

Let's Verify Step by Step

Paper • 2305.20050 • Published May 31, 2023 • 10

Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning

Paper • 2406.12050 • Published Jun 17 • 19

upvoted a collection about 1 month ago

Top LLM

Collection of TOP Open Source LLM, Sort by Best on top • 6 items • Updated Jul 26 • 13

upvoted 6 papers about 2 months ago

Large Language Models Orchestrating Structured Reasoning Achieve Kaggle Grandmaster Level

Paper • 2411.03562 • Published Nov 5 • 63

What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective

Paper • 2410.23743 • Published Oct 31 • 59

LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations

Paper • 2410.02707 • Published Oct 3 • 47

GPT-4o System Card

Paper • 2410.21276 • Published Oct 25 • 82

Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

Paper • 2406.08464 • Published Jun 12 • 65

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning

Paper • 2410.02884 • Published Oct 3 • 52