SmolVLM - small yet mighty Vision Language Model
β’
146
Elie Bakouch
eliebak
AI & ML interests
Training LLM's @ π€
Recent Activity
liked
a model
about 3 hours ago
deepseek-ai/DeepSeek-V3-Base
upvoted
an
article
1 day ago
π#81: Key AI Concepts to Follow in 2025
liked
a model
4 days ago
answerdotai/ModernBERT-base
Articles
Organizations
eliebak's activity
liked
a
model
about 3 hours ago
upvoted
an
article
1 day ago
Article
π#81: Key AI Concepts to Follow in 2025
By
β’
β’
13
liked
a
model
4 days ago
upvoted
a
paper
5 days ago
reacted to
anton-l's
post with π₯
6 days ago
Post
1965
Introducing ππ
π’π§πππππ‘: the best public math pre-training dataset with 50B+ tokens!
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
π οΈ carefully extracting math data from Common Crawl;
π iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! π
Weβre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
π οΈ carefully extracting math data from Common Crawl;
π iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! π
Weβre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
updated
a
collection
6 days ago
updated
9
models
6 days ago
HuggingFaceTB/finemath-ablation-infiwebmath
Updated
β’
9
HuggingFaceTB/finemath-ablation-4plus-160B
Updated
β’
11
HuggingFaceTB/finemath-ablation-fwedu
Updated
β’
13
HuggingFaceTB/finemath-ablation-infiwebmath-3plus
Updated
β’
13
HuggingFaceTB/finemath-ablation-owm
Updated
β’
12
HuggingFaceTB/finemath-ablation-finemath-4plus
Updated
β’
24
β’
1
HuggingFaceTB/finemath-ablation-infiwebmath-4plus
Updated
β’
96
β’
2
HuggingFaceTB/finemath-ablation-finemath-3plus
Updated
β’
14
HuggingFaceTB/finemath-ablation-3plus-160B
Updated
β’
37
liked
a
model
6 days ago
updated
a
model
6 days ago
updated
2
models
7 days ago