Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 30, 2025

• Improve readability of the quick tour. (#501)

  Show description for 515bd01
  vxw3t8fhjsdkghvbdifuk

  authored
  515bd01

  Copy full SHA for 515bd01

Commits on Jan 29, 2025

• Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

  Show description for 94fc5a2
  JoelNiklaus

  authored
  94fc5a2

  Copy full SHA for 94fc5a2

• add missing inits (#524)

  hynky1999

  authored
  48d0c28

  Copy full SHA for 48d0c28

Commits on Jan 28, 2025

• Math extraction - allow only trying the first match, more customizable latex extraction + bump deps (#522)

  Show description for 0e46269
  

  hynky1999

  and

  clefourrier

  authored
  0e46269

  Copy full SHA for 0e46269

Commits on Jan 26, 2025

• Fixing commonsense qa: generative metrics, -1 gen length (#517)

  clefourrier

  authored
  cb075a5

  Copy full SHA for cb075a5

• Fix Ukrainian indices and confirmation word (#516)

  ayukh

  authored
  499cc82

  Copy full SHA for 499cc82

Commits on Jan 24, 2025

• Fixed bug of import url_to_fs from fsspec (#507) (#512)

  Show description for 4f381b3
  

  LoserCheems

  and

  clefourrier

  authored
  4f381b3

  Copy full SHA for 4f381b3

Commits on Jan 23, 2025

• Bump up the latex2sympy2_extended version + more tests (#510)

  Show description for 0ab63d0
  

  hynky1999

  and

  clefourrier

  authored
  0ab63d0

  Copy full SHA for 0ab63d0

• Support custom results/details push to hub (#457)

  Show description for c82143a
  albertvillanova

  authored
  c82143a

  Copy full SHA for c82143a

• Add custom tasks for evaluation of french models (#505)

  Show description for 7028af3
  mdiazmel

  authored
  7028af3

  Copy full SHA for 7028af3

• llm_as_a_judge_for_oallv2_arabic (#498)

  Show description for 620873b
  Manel-Hik

  authored
  620873b

  Copy full SHA for 620873b

• Relax upper bound on torch (#508)

  lewtun

  authored
  5f5bed5

  Copy full SHA for 5f5bed5

Commits on Jan 22, 2025

• Translate task template to Catalan and Galician and fix typos (#506)

  mariagrandury

  authored
  1ae2fa2

  Copy full SHA for 1ae2fa2

Commits on Jan 20, 2025

• Made judge response processing more robust. (#491)

  JoelNiklaus

  authored
  0140578

  Copy full SHA for 0140578

• feat: add asian language support to CorpusLevelTranslationMetric (#479)

  Show description for be18ae5
  ryan-minato

  authored
  be18ae5

  Copy full SHA for be18ae5

• Hotfix for litellm judge (#490)

  Show description for fee2ec3
  

  JoelNiklaus

  and

  clefourrier

  authored
  fee2ec3

  Copy full SHA for fee2ec3

• Fixed issue with o1 in litellm. (#493)

  JoelNiklaus

  authored
  3b89734

  Copy full SHA for 3b89734

Commits on Jan 18, 2025

• Fix math extraction (#503)

  Show description for 90d44c1
  

  hynky1999

  and

  clefourrier

  authored
  90d44c1

  Copy full SHA for 90d44c1

Commits on Jan 15, 2025

• Extractive Match metric (#495)

  Show description for 59624c8
  

  hynky1999

  and

  clefourrier

  authored
  59624c8

  Copy full SHA for 59624c8

Commits on Jan 14, 2025

• fix README link (#500)

  vxw3t8fhjsdkghvbdifuk

  authored
  a7aa6ed

  Copy full SHA for a7aa6ed

Commits on Jan 7, 2025

• Fix T_co import bug (#484)

  Show description for 6560c75
  gucci-j

  authored
  6560c75

  Copy full SHA for 6560c75

• Made litellm judge backend more robust. (#485)

  Show description for fdb12f4
  

  JoelNiklaus

  and

  clefourrier

  authored
  fdb12f4

  Copy full SHA for fdb12f4

• Fix issue with encodings for together models. (#483)

  JoelNiklaus

  authored
  2073a29

  Copy full SHA for 2073a29

Commits on Jan 6, 2025

• Update README.md (#486)

  NathanHB

  authored
  f6fee3a

  Copy full SHA for f6fee3a

Commits on Jan 3, 2025

• Tiny improvements to endpoint_model.py, base_model.py,... (#219)

  Show description for 452e031
  

  3 peopleauthored
  452e031

  Copy full SHA for 452e031

Commits on Jan 2, 2025

• Homogeneize generation params (#428)

  Show description for 5a28b22
  

  3 peopleauthored
  5a28b22

  Copy full SHA for 5a28b22

• fix model parallel (#481)

  Show description for 24afde2
  NathanHB

  authored
  24afde2

  Copy full SHA for 24afde2

• Add litellm inference (#385)

  Show description for a2541b1
  

  8 peopleauthored
  a2541b1

  Copy full SHA for a2541b1

Commits on Dec 26, 2024

• fix: scorer attribute initialization in ROUGE (#471)

  Show description for 2ef9740
  

  ryan-minato

  and

  clefourrier

  authored
  2ef9740

  Copy full SHA for 2ef9740

• fix: LightevalTaskConfig.stop_sequence attribute (#463)

  Show description for 9ff194d
  

  ryan-minato

  and

  NathanHB

  authored
  9ff194d

  Copy full SHA for 9ff194d

• Delete endpoint on InferenceEndpointTimeoutError (#475)

  albertvillanova

  authored
  801c21a

  Copy full SHA for 801c21a

Commits on Dec 21, 2024

• Checkout PR merge commit for CI tests (#468)

  albertvillanova

  authored
  8568e72

  Copy full SHA for 8568e72

Commits on Dec 20, 2024

• Fix warning about precedence of custom tasks over default ones in registry (#466)

  Show description for 264f3f8
  albertvillanova

  authored
  264f3f8

  Copy full SHA for 264f3f8

• Update arabic_evals.py: Fix custom arabic tasks [2nd attempt] (#444)

  Show description for fbca143
  

  3 peopleauthored
  fbca143

  Copy full SHA for fbca143

Commits on Dec 19, 2024

• Remove unnecessary deepcopy in evaluation_tracker (#459)

  Show description for a1c610d
  albertvillanova

  authored
  a1c610d

  Copy full SHA for a1c610d

Pagination

Previous

Next