Post
1401
What a beginning to this year in open ML đ¤
Let's unwrap! merve/jan-10-releases-677fe34177759de0edfc9714
Multimodal đźď¸
> ByteDance released SA2VA: a family of vision LMs that can take image, video, text and visual prompts
> moondream2 is out with new capabilities like outputting structured data and gaze detection!
> Dataset: Alibaba DAMO lab released multimodal textbook â 22k hours worth of samples from instruction videos đ¤Ż
> Dataset: SciCap captioning on scientific documents benchmark dataset is released along with the challenge!
LLMs đŹ
> Microsoft released Phi-4, sota open-source 14B language model đĽ
> Dolphin is back with Dolphin 3.0 Llama 3.1 8B đŹđŹ
> Prime-RL released Eurus-2-7B-PRIME a new language model trained using PRIME alignment
> SmallThinker-3B is a new small reasoning LM based on Owen2.5-3B-Instruct đ
> Dataset: QWQ-LONGCOT-500K is the dataset used to train SmallThinker, generated using QwQ-32B-preview đ
> Dataset: @cfahlgren1 released React Code Instructions: a dataset of code instruction-code pairs đ
> Dataset: Qwen team is on the roll, they just released CodeElo, a dataset of code preferences đŠđťâđť
Embeddings đ
> @MoritzLaurer released zero-shot version of ModernBERT large đ
> KaLM is a new family of performant multilingual embedding models with MIT license built using Qwen2-0.5B
Image/Video Generation âŻď¸
> NVIDIA released Cosmos, a new family of diffusion/autoregressive World Foundation Models generating worlds from images, videos and texts đĽ
> Adobe released TransPixar: a new text-to-video model that can generate assets with transparent backgrounds (a first!)
> Dataset: fal released cosmos-openvid-1m Cosmos-tokenized OpenVid-1M with samples from OpenVid-1M
Others
> Prior Labs released TabPFNv2, the best tabular transformer is out for classification and regression
> Metagene-1 is a new RNA language model that can be used for pathogen detection, zero-shot embedding and genome understanding
Let's unwrap! merve/jan-10-releases-677fe34177759de0edfc9714
Multimodal đźď¸
> ByteDance released SA2VA: a family of vision LMs that can take image, video, text and visual prompts
> moondream2 is out with new capabilities like outputting structured data and gaze detection!
> Dataset: Alibaba DAMO lab released multimodal textbook â 22k hours worth of samples from instruction videos đ¤Ż
> Dataset: SciCap captioning on scientific documents benchmark dataset is released along with the challenge!
LLMs đŹ
> Microsoft released Phi-4, sota open-source 14B language model đĽ
> Dolphin is back with Dolphin 3.0 Llama 3.1 8B đŹđŹ
> Prime-RL released Eurus-2-7B-PRIME a new language model trained using PRIME alignment
> SmallThinker-3B is a new small reasoning LM based on Owen2.5-3B-Instruct đ
> Dataset: QWQ-LONGCOT-500K is the dataset used to train SmallThinker, generated using QwQ-32B-preview đ
> Dataset: @cfahlgren1 released React Code Instructions: a dataset of code instruction-code pairs đ
> Dataset: Qwen team is on the roll, they just released CodeElo, a dataset of code preferences đŠđťâđť
Embeddings đ
> @MoritzLaurer released zero-shot version of ModernBERT large đ
> KaLM is a new family of performant multilingual embedding models with MIT license built using Qwen2-0.5B
Image/Video Generation âŻď¸
> NVIDIA released Cosmos, a new family of diffusion/autoregressive World Foundation Models generating worlds from images, videos and texts đĽ
> Adobe released TransPixar: a new text-to-video model that can generate assets with transparent backgrounds (a first!)
> Dataset: fal released cosmos-openvid-1m Cosmos-tokenized OpenVid-1M with samples from OpenVid-1M
Others
> Prior Labs released TabPFNv2, the best tabular transformer is out for classification and regression
> Metagene-1 is a new RNA language model that can be used for pathogen detection, zero-shot embedding and genome understanding
