Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
giux78 
posted an update 4 days ago
Post
3041
This is truly an inspirational story please help us spread the word, @clem , @thomwolf and everyone who supports open source AI.

A few weeks ago, @mmuffo94 and @cittiberto from indigo_ai launched the Chatbot Arena for the Italian language: https://indigo.ai/it/chatbot-arena-italia/.

To our surprise, among the top-ranked models is mii-llm/maestrale-chat-v0.4-beta a carefully fine-tuned version of mistralai/Mistral-7B-v0.1, developed by @efederici and @mferraretto from https://huggingface.co./mii-llm, and released nearly a year ago.

At this very moment, as shown in the screenshot, mii-llm/maestrale-chat-v0.4-beta is ranked 8th right between ChatGPT-4.5 and ChatGPT-4o.

It's likely that for several months, the best Italian speaking LLM has been an open source 7B model created by open source contributors and hardly anyone knew it.

Great, but sadly, it is not free software, it disallows people using it commercially.

I wonder why authors of models cannot understand the point. That way they truly get less money, less recognition.

I'm not surprised actually. The developers of ChatGPT and DeepSeek probably aren't trying to maximize Italian benchmarks. For specialized tasks, well-trained small models can beat much bigger ones. Certainly, the Italians know what kind of fresh high-quality ingredients are best for training their model.

Also, not every hobby project needs to be commercialized. In many cases Mistral is fine.