Post
3129
What a beginning to this year in open ML š¤
Let's unwrap! merve/jan-10-releases-677fe34177759de0edfc9714
Multimodal š¼ļø
> ByteDance released SA2VA: a family of vision LMs that can take image, video, text and visual prompts
> moondream2 is out with new capabilities like outputting structured data and gaze detection!
> Dataset: Alibaba DAMO lab released multimodal textbook ā 22k hours worth of samples from instruction videos š¤Æ
> Dataset: SciCap captioning on scientific documents benchmark dataset is released along with the challenge!
LLMs š¬
> Microsoft released Phi-4, sota open-source 14B language model š„
> Dolphin is back with Dolphin 3.0 Llama 3.1 8B š¬š¬
> Prime-RL released Eurus-2-7B-PRIME a new language model trained using PRIME alignment
> SmallThinker-3B is a new small reasoning LM based on Owen2.5-3B-Instruct š
> Dataset: QWQ-LONGCOT-500K is the dataset used to train SmallThinker, generated using QwQ-32B-preview š
> Dataset: @cfahlgren1 released React Code Instructions: a dataset of code instruction-code pairs š
> Dataset: Qwen team is on the roll, they just released CodeElo, a dataset of code preferences š©š»āš»
Embeddings š
> @MoritzLaurer released zero-shot version of ModernBERT large š
> KaLM is a new family of performant multilingual embedding models with MIT license built using Qwen2-0.5B
Image/Video Generation āÆļø
> NVIDIA released Cosmos, a new family of diffusion/autoregressive World Foundation Models generating worlds from images, videos and texts š„
> Adobe released TransPixar: a new text-to-video model that can generate assets with transparent backgrounds (a first!)
> Dataset: fal released cosmos-openvid-1m Cosmos-tokenized OpenVid-1M with samples from OpenVid-1M
Others
> Prior Labs released TabPFNv2, the best tabular transformer is out for classification and regression
> Metagene-1 is a new RNA language model that can be used for pathogen detection, zero-shot embedding and genome understanding
Let's unwrap! merve/jan-10-releases-677fe34177759de0edfc9714
Multimodal š¼ļø
> ByteDance released SA2VA: a family of vision LMs that can take image, video, text and visual prompts
> moondream2 is out with new capabilities like outputting structured data and gaze detection!
> Dataset: Alibaba DAMO lab released multimodal textbook ā 22k hours worth of samples from instruction videos š¤Æ
> Dataset: SciCap captioning on scientific documents benchmark dataset is released along with the challenge!
LLMs š¬
> Microsoft released Phi-4, sota open-source 14B language model š„
> Dolphin is back with Dolphin 3.0 Llama 3.1 8B š¬š¬
> Prime-RL released Eurus-2-7B-PRIME a new language model trained using PRIME alignment
> SmallThinker-3B is a new small reasoning LM based on Owen2.5-3B-Instruct š
> Dataset: QWQ-LONGCOT-500K is the dataset used to train SmallThinker, generated using QwQ-32B-preview š
> Dataset: @cfahlgren1 released React Code Instructions: a dataset of code instruction-code pairs š
> Dataset: Qwen team is on the roll, they just released CodeElo, a dataset of code preferences š©š»āš»
Embeddings š
> @MoritzLaurer released zero-shot version of ModernBERT large š
> KaLM is a new family of performant multilingual embedding models with MIT license built using Qwen2-0.5B
Image/Video Generation āÆļø
> NVIDIA released Cosmos, a new family of diffusion/autoregressive World Foundation Models generating worlds from images, videos and texts š„
> Adobe released TransPixar: a new text-to-video model that can generate assets with transparent backgrounds (a first!)
> Dataset: fal released cosmos-openvid-1m Cosmos-tokenized OpenVid-1M with samples from OpenVid-1M
Others
> Prior Labs released TabPFNv2, the best tabular transformer is out for classification and regression
> Metagene-1 is a new RNA language model that can be used for pathogen detection, zero-shot embedding and genome understanding
