Moritz Laurer's picture

Moritz Laurer

MoritzLaurer

·

https://www.linkedin.com/in/moritz-laurer/

AI & ML interests

None yet

Recent Activity

posted an update about 3 hours ago

FACTS is a great paper from @GoogleDeepMind on measuring the factuality of LLM outputs. You can now download their prompt templates from @huggingface to improve LLM-based fact-checking yourself! 📏 The paper introduces the FACTS Grounding benchmark for evaluating the factuality of LLM outputs. 🤖 Fact-checking is automated by an ensemble of LLM judges that verify if a response is fully grounded in a factual reference document. 🧪 The authors tested different prompt templates on held-out data to ensure their generalization. 📚 It's highly educational to read these templates to learn how frontier labs design prompts and understand their limitations. 💾 You can now download and reuse these prompt templates via the prompt-templates library! 🔄 The library simplifies sharing prompt templates on the HF hub or locally via standardized YAML files. Let’s make LLM work more transparent and reproducible by sharing more templates like this! Links 👇 - prompt-templates docs: https://moritzlaurer.github.io/prompt_templates/ - all templates on the HF Hub: https://huggingface.co/datasets/MoritzLaurer/facts-grounding-prompts - FACTS paper: https://storage.googleapis.com/deepmind-media/FACTS/FACTS_grounding_paper.pdf

reacted to merve's post with ❤️ about 23 hours ago

What a beginning to this year in open ML 🤠 Let's unwrap! https://huggingface.co/collections/merve/jan-10-releases-677fe34177759de0edfc9714 Multimodal 🖼️ > ByteDance released SA2VA: a family of vision LMs that can take image, video, text and visual prompts > moondream2 is out with new capabilities like outputting structured data and gaze detection! > Dataset: Alibaba DAMO lab released multimodal textbook — 22k hours worth of samples from instruction videos 🤯 > Dataset: SciCap captioning on scientific documents benchmark dataset is released along with the challenge! LLMs 💬 > Microsoft released Phi-4, sota open-source 14B language model 🔥 > Dolphin is back with Dolphin 3.0 Llama 3.1 8B 🐬🐬 > Prime-RL released Eurus-2-7B-PRIME a new language model trained using PRIME alignment > SmallThinker-3B is a new small reasoning LM based on Owen2.5-3B-Instruct 💭 > Dataset: QWQ-LONGCOT-500K is the dataset used to train SmallThinker, generated using QwQ-32B-preview 📕 > Dataset: @cfahlgren1 released React Code Instructions: a dataset of code instruction-code pairs 📕 > Dataset: Qwen team is on the roll, they just released CodeElo, a dataset of code preferences 👩🏻‍💻 Embeddings 🔖 > @MoritzLaurer released zero-shot version of ModernBERT large 👏 > KaLM is a new family of performant multilingual embedding models with MIT license built using Qwen2-0.5B Image/Video Generation ⏯️ > NVIDIA released Cosmos, a new family of diffusion/autoregressive World Foundation Models generating worlds from images, videos and texts 🔥 > Adobe released TransPixar: a new text-to-video model that can generate assets with transparent backgrounds (a first!) > Dataset: fal released cosmos-openvid-1m Cosmos-tokenized OpenVid-1M with samples from OpenVid-1M Others > Prior Labs released TabPFNv2, the best tabular transformer is out for classification and regression > Metagene-1 is a new RNA language model that can be used for pathogen detection, zero-shot embedding and genome understanding

posted an update 2 days ago

The TRL v0.13 release is 🔥! My highlight are the new process reward trainer to train models similar to o1 and tool call support: 🧠 Process reward trainer: Enables training of Process-supervised Reward Models (PRMs), which reward the quality of intermediate steps, promoting structured reasoning. Perfect for tasks like stepwise reasoning. 🔀 Model merging: A new callback leverages mergekit to merge models during training, improving performance by blending reference and policy models - optionally pushing merged models to the Hugging Face Hub. 🛠️ Tool call support: TRL preprocessing now supports tool integration, laying the groundwork for agent fine-tuning with examples like dynamic temperature fetching in prompts. ⚖️ Mixture of judges: The new AllTrueJudge combines decisions from multiple binary judges for more nuanced evaluation. Read the release notes and other resources here 👇 Release: https://github.com/huggingface/trl/releases/tag/v0.13.0 Mergekit: https://github.com/arcee-ai/mergekit Mixture of judges paper: https://huggingface.co/papers/2409.20370

View all activity

Articles

Going multimodal: How Prezi is leveraging the Hub and the Expert Support Program to accelerate their ML roadmap

Synthetic data: save money, time and carbon with open source

Organizations

MoritzLaurer's activity

upvoted a collection 4 days ago

Cosmos

The collection of Cosmos models • 31 items • Updated about 9 hours ago • 206

upvoted an article 4 days ago

Article

Announcing NVIDIA Cosmos World Foundation Models

By

•

4 days ago

• 21

upvoted a paper 4 days ago

The Perfect Blend: Redefining RLHF with Mixture of Judges

Paper • 2409.20370 • Published Sep 30, 2024 • 5

upvoted an article 17 days ago

Article

🌁#81: Key AI Concepts to Follow in 2025

By

•

19 days ago

• 24

upvoted a paper 22 days ago

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published 24 days ago • 121

upvoted a collection 26 days ago

Qwen2-VL

Vision-language model series based on Qwen2 • 16 items • Updated Dec 6, 2024 • 188

upvoted a collection about 1 month ago

PaliGemma 2 Release

Vision-Language Models available in multiple 3B, 10B and 28B variants. • 23 items • Updated 29 days ago • 125

upvoted a paper about 1 month ago

PaliGemma 2: A Family of Versatile VLMs for Transfer

Paper • 2412.03555 • Published Dec 4, 2024 • 121

upvoted a collection about 1 month ago

PixMo

A set of vision-language datasets built by Ai2 and used to train the Molmo family of models. Read more at https://molmo.allenai.org/blog • 9 items • Updated 5 days ago • 53

upvoted a collection about 2 months ago

Qwen2.5

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 45 items • Updated Nov 28, 2024 • 457

upvoted a collection 2 months ago

SmolLM2

State-of-the-art compact LLMs for on-device applications: 1.7B, 360M, 135M • 15 items • Updated 20 days ago • 198

upvoted a paper 2 months ago

GPT-4o System Card

Paper • 2410.21276 • Published Oct 25, 2024 • 83

upvoted a collection 2 months ago

Dinov2

5 items • Updated Jan 16, 2024 • 15

upvoted 3 articles 3 months ago

Article

How to optimize your data labelling project with custom interfaces

By

•

Oct 16, 2024

• 18

Article

Inference Endpoints Changelog 🚀

By

•

Oct 11, 2024

• 19

Article

Welcome, Gradio 5

Oct 9, 2024

• 97

upvoted a paper 3 months ago

Emu3: Next-Token Prediction is All You Need

Paper • 2409.18869 • Published Sep 27, 2024 • 94

upvoted a paper 4 months ago

Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models

Paper • 2409.17146 • Published Sep 25, 2024 • 106

upvoted a collection 4 months ago

Molmo

Artifacts for open multimodal language models. • 5 items • Updated 5 days ago • 292

upvoted an article 4 months ago

Article

2024 Security Feature Highlights

Aug 6, 2024

• 16