3 Pull requests merged by 2 people

• [ci] remove daily step retry and update pr score

  #1782 merged Dec 26, 2024

• [Update] Volc status exception handle

  #1780 merged Dec 26, 2024

• [ci] remove testcase into volc engine

  #1777 merged Dec 25, 2024

3 Pull requests opened by 3 people

• [Feature] Support G-Pass@k and LiveMathBench

  #1772 opened Dec 20, 2024

• [Feature] Support MMLU-CF Benchmark

  #1775 opened Dec 24, 2024

• [Update] Add Theorem QA 0shot CoT config

  #1783 opened Dec 26, 2024

3 Issues opened by 3 people

• [Bug] Academic Leaderboard 结果无法对齐，Summary只展示部分

  #1779 opened Dec 25, 2024

• [Feature] 是否打算支持mamba或者mamba2的测评吗

  #1778 opened Dec 25, 2024

• [Bug] torch.OutOfMemoryError

  #1773 opened Dec 23, 2024

3 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [Bug] 推理完成了，但是因为插件版本，在做测评的时候报错了，但是预测的哪些文件都在，怎么重新继续做预测？还有就是运行的时候默认好像是多有的数据集都会测试

  #1761 commented on Dec 23, 2024 • 0 new comments

• [Bug] 微调过的Qwen2.5-7b输出全是感叹号/The output of fine-tuning Qwen2.5-7b is '！！！！！！'

  #1732 commented on Dec 25, 2024 • 0 new comments

• [Bug] 无法多卡并行评测数据

  #1755 commented on Dec 26, 2024 • 0 new comments