Skip to content

Pull requests: huggingface/lighteval

New pull request New
40 Open 510 Closed
40 Open 510 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Save reasoning_content from litellm as details
#929 opened Aug 19, 2025 by muupan Loading…
1
Test for the xet hub team
#928 opened Aug 19, 2025 by clefourrier Loading…
3
Parametrizing the sampling evals from the CLI
#926 opened Aug 18, 2025 by clefourrier • Draft
11
Update to datasets 4.0
#924 opened Aug 15, 2025 by NathanHB Loading…
1
Update translation_literals.py
#923 opened Aug 15, 2025 by dianaonutu Loading…
9
fix tasks list
#906 opened Aug 7, 2025 by alielfilali01 Loading…
22
Initial implementation for chat template parameters
#904 opened Aug 6, 2025 by LysandreJik • Draft
3
Debug continuous batching
#900 opened Aug 5, 2025 by clefourrier • Draft
1
MMLU Redux
#883 opened Jul 25, 2025 by clefourrier Loading…
2
Fix #742
#860 opened Jul 14, 2025 by mcleish7 Loading…
1
add additional_messages parameters to forward OpenAi style messages to inference providers
#859 opened Jul 10, 2025 by mfuntowicz Loading…
3
Add Filipino Benchmark Community Tasks
#852 opened Jul 7, 2025 by ljvmiranda921 Loading…
15
Save and output number of samples of each task
#851 opened Jul 3, 2025 by itsmejul Loading…
1
2
Multilingual Overhaul
#833 opened Jun 25, 2025 by hynky1999 Loading…
Adding a range of multilingual evals
#832 opened Jun 25, 2025 by clefourrier • Draft
3
Added fallback for incomplete configs for vlm models launched as llms
#828 opened Jun 24, 2025 by clefourrier Loading…
1
@clefourrier
1
fix: add offline dataset support via LOCAL_DATASET_PATH
#807 opened Jun 10, 2025 by xjli360 Loading…
3
fix context size check in sglang model
#787 opened May 29, 2025 by xgwang Loading…
3
Add support for vLLM KV-cache quantization
#773 opened May 22, 2025 by eldarkurtic Loading…
1
Add Romanian literals feature/enhancement New feature/request
#764 opened May 21, 2025 by dianaonutu Loading…
7
Newer openai and loosened httpx
#758 opened May 21, 2025 by jamesbraza Loading…
1
4
Add Chinese (zh) Translation of Documentation documentation Improvements or additions to documentation
#744 opened May 19, 2025 by CassiopeiaCode Loading…
13
Adds RULER benchmark new-task
#722 opened May 15, 2025 by NathanHB Loading…
1
16
[WIP] Fix nanotron compatibility
#706 opened May 6, 2025 by duynht Loading…
3
Add way to load local datafile feature/enhancement New feature/request
#687 opened Apr 24, 2025 by ScottHoang Loading…
1
2
ProTip! Filter pull requests by the default branch with base:main.