Skip to content

Issues: TIGER-AI-Lab/MMLU-Pro

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

OpenAI o1-preview and o1-mini
#21 opened Sep 17, 2024 by EwoutH updated Jan 18, 2025
Redundant line in evaluate_from_local.py
#63 opened Jan 15, 2025 by Wayfarer123 updated Jan 15, 2025
Add Grok-1212
#61 opened Dec 19, 2024 by johns2s updated Dec 19, 2024
Add DeepSeek-V2.5-1210
#58 opened Dec 13, 2024 by EwoutH updated Dec 13, 2024
Add Amazon Nova models
#51 opened Dec 4, 2024 by EwoutH updated Dec 4, 2024
3 tasks
Add Gemini-Exp-1114 and Gemini-Exp-1121
#47 opened Nov 18, 2024 by EwoutH updated Nov 22, 2024
2 tasks
ProTip! Exclude everything labeled bug with -label:bug.