New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fixes to HELM capabilities #3225

Merged

yifanmai merged 1 commit into main from yifanmai/fix-capabilities

Dec 19, 2024

Collaborator

yifanmai commented Dec 19, 2024

Fix incorrect package name in OmniMathAnnotator
Fix incorrect metrics for mmlu_pro
Fix incorrect prompts for GPQA (fixes bug in Changes for MMLU PRO with COT #3200)
Fix incorrect metric names in schema


          Fixes to HELM capabilities

cb94c1a

yifanmai merged commit f14e139 into main

8 checks passed

yifanmai deleted the yifanmai/fix-capabilities branch

December 19, 2024 23:08

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet