FineWeb2-C: Help Build Better Language Models in Your Language
β’
10
Daniel van Strien PRO
davanstrien
AI & ML interests
Machine Learning Librarian
Recent Activity
updated
a dataset
about 5 hours ago
librarian-bots/dataset_cards_with_metadata
updated
a dataset
about 6 hours ago
data-is-better-together/fineweb-c-progress
updated
a model
about 15 hours ago
knowledgator/modern-gliner-bi-large-v1.0
Articles
Organizations
Posts
38
Post
1502
Introducing FineWeb-C ππ, a community-built dataset for improving language models in ALL languages.
Inspired by FineWeb-Edu the community is labelling the educational quality of texts for many languages.
318 annotators, 32K+ annotations, 12 languages - and growing! π
data-is-better-together/fineweb-c
Inspired by FineWeb-Edu the community is labelling the educational quality of texts for many languages.
318 annotators, 32K+ annotations, 12 languages - and growing! π
data-is-better-together/fineweb-c
Post
485
Increasingly, LLMs are becoming very useful for helping scale annotation tasks, i.e. labelling and filtering. When combined with the structured generation, this can be a very scalable way of doing some pre-annotation without requiring a large team of human annotators.
However, there are quite a few cases where it still doesn't work well. This is a nice paper looking at the limitations of LLM as an annotator for Low Resource Languages: On Limitations of LLM as Annotator for Low Resource Languages (2411.17637).
Humans will still have an important role in the loop to help improve models for all languages (and domains).
However, there are quite a few cases where it still doesn't work well. This is a nice paper looking at the limitations of LLM as an annotator for Low Resource Languages: On Limitations of LLM as Annotator for Low Resource Languages (2411.17637).
Humans will still have an important role in the loop to help improve models for all languages (and domains).
Collections
20
A collection of demos for various approaches to synthetic data generation
Example of using distilabel to generate synthetic triplets data for fine-tuning a Sentence Transformer model
-
bigcode/self-oss-instruct-sc2-exec-filter-50k
Viewer β’ Updated β’ 50.7k β’ 181 β’ 92 -
davanstrien/similarity-dataset-sc2-8b
Viewer β’ Updated β’ 2.32k β’ 67 β’ 6 -
davanstrien/code-prompt-similarity-model
Sentence Similarity β’ Updated β’ 15 β’ 6 -
davanstrien/abstract-wiki
Viewer β’ Updated β’ 5k β’ 58 β’ 1
spaces
48
models
136
davanstrien/modernBERT-imdb
Updated
β’
5
davanstrien/modernBert_imdb
Updated
davanstrien/fineweb-edu-classifier-onnx
Text Classification
β’
Updated
β’
8
davanstrien/Qwen2.5-0.5B-Instruct-extra-token
Text Generation
β’
Updated
β’
13
davanstrien/document-classifier-convnextv2-tiny-22k-224
Image Classification
β’
Updated
β’
10
davanstrien/document-classifier-convnextv2-tiny-1k-224
Image Classification
β’
Updated
β’
7
davanstrien/document-classifier-deit_base_patch16_224
Image Classification
β’
Updated
β’
4
davanstrien/contrastive-bert-base-uncased
Sentence Similarity
β’
Updated
β’
22
davanstrien/convnextv2-tiny-1k-224-text
Image Classification
β’
Updated
β’
16
davanstrien/test-timm
Image Classification
β’
Updated
β’
113
datasets
298
davanstrien/magpie-preference
Viewer
β’
Updated
β’
503
β’
683
β’
12
davanstrien/test_audio
Viewer
β’
Updated
β’
100
β’
40
davanstrien/test-card
Updated
β’
35
davanstrien/progress
Viewer
β’
Updated
β’
298
β’
74
davanstrien/fineweb-edu-llama3-annotations-sample-5-ratings-100-raw
Viewer
β’
Updated
β’
100
β’
76
davanstrien/fineweb-edu-llama3-annotations-sample
Viewer
β’
Updated
β’
100
β’
44
davanstrien/fineweb-edu-llama3-annotations-pairs-data-sample-ranked-raw
Viewer
β’
Updated
β’
248
β’
46
davanstrien/fineweb-edu-llama3-annotations-pairs-data
Viewer
β’
Updated
β’
248
β’
43
davanstrien/would-you-read-it
Viewer
β’
Updated
β’
266
β’
158
β’
4
davanstrien/exaple_audio_image_text_triplet
Viewer
β’
Updated
β’
1
β’
41