Hugging Face's logo

Occiglot

community
https://occiglot.eu/
occiglot
occiglot
Activity Feed

AI & ML interests

Open Source Language Models for Europe

Recent Activity

barthfab  updated a dataset 12 days ago
occiglot/euro-llm-leaderboard-requests
barthfab  new activity 12 days ago
occiglot/euro-llm-leaderboard:It seems this Leaderboard has been abandoned?
malteos  authored a paper 16 days ago
Tokenizer Choice For LLM Training: Negligible or Crucial?
View all activity

occiglot's activity

stefan-it 
posted an update 6 days ago
view post
Post
771
🇹🇷 😍 I'm very happy to finally announce my new Turkish LM called "BERT5urk":

stefan-it/bert5urk

It is a 1.42B T5-based model, trained with UL2 pretraining objective on the Turkish part of the awesome HuggingFaceFW/fineweb-2 dataset.

Feel free to check it out!
  • 1 reply
·
stefan-it 
posted an update 10 days ago
view post
Post
3101
After running some 3DMark and FurMark benchmarks on Windows to make sure that my new 5090 is not causing melting cables [1] and some nice shots with a thermal camera (I don't think that's too much), running some fine-tuning experiments with my favorite Flair & Transformers libraries are very easy to perform.

Important steps:

Good idea is to start with a fresh Ubuntu 24.04 installation with latest CUDA 12.8 and the open NVIDIA driver - follow more advices from [2]:

sudo apt -y install cuda-toolkit-12-8 nvidia-open

I tried update from an existing Ubuntu installation with an older CUDA and driver version and it resulted in a non-startable system.

If you are using PyTorch 2.6 with built CUDA 12.6 it will result in:

NVIDIA Graphics Device with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.

But no worries! For PyTorch you need just to use a nightly 2.7 version that was built with CUDA 12.8. This can easily done via:

pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu128

After that the latest Flair version can be installed and fine-tuning will work!

References:

[1]: https://www.reddit.com/r/nvidia/comments/1inpox7/rtx_50_series_12vhpwr_megathread/
[2]: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network
  • 1 reply
·
barthfab 
updated a dataset 12 days ago
barthfab 
in occiglot/euro-llm-leaderboard 12 days ago

It seems this Leaderboard has been abandoned?

1
#6 opened 12 days ago by
StarscreamDeceptions
stefan-it 
posted an update 13 days ago
view post
Post
5061
She arrived 😍

[Expect more models soon...]
  • 2 replies
·
malteos 
authored 10 papers 16 days ago
PSaiml 
authored a paper about 2 months ago
s-conia 
authored 4 papers about 2 months ago