Skip to content

Pull requests: huggingface/lighteval

New pull request New
14 Open 125 Closed
14 Open 125 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Adding OZ Eval task
#225 opened Jul 15, 2024 by Stopwolf Loading…
Quantization related issues
#224 opened Jul 11, 2024 by clefourrier Loading…
1
3
adds llm as judge using transformers
#223 opened Jul 11, 2024 by NathanHB • Draft
Fixing PIQA implementation
#222 opened Jul 11, 2024 by clefourrier Loading…
1
Small improvements to endpoint_model.py, base_model.py,...
#219 opened Jul 8, 2024 by sadra-barikbin Loading…
2
A small improvement in metrics_sample.py::ROUGE
#217 opened Jul 7, 2024 by sadra-barikbin Loading…
4
Make evaluator invariant of input request type order
#215 opened Jul 5, 2024 by sadra-barikbin Loading…
1
8
Add metrics as functions
#214 opened Jul 5, 2024 by clefourrier Loading…
2
Ar support for MBZUAI-arabic-mmlu
#209 opened Jul 3, 2024 by bakrianoo Loading…
7
Fix _init_max_length in base_model.py
#185 opened May 4, 2024 by gucci-j Loading…
9
Transformers model as Judge
#174 opened Apr 26, 2024 by anilaltuner Loading…
8
Nanotron tests
#160 opened Apr 19, 2024 by zzhhjjj Loading…
5
launch lighteval using lighteval --args
#152 opened Apr 10, 2024 by NathanHB Loading…
11
Add optimum model
#106 opened Mar 11, 2024 by echarlaix • Draft
ProTip! What’s not been updated in a month: updated:<2024-06-16.