Commits

Branch selector

 main

User selector

NathanHB

Datepicker

All time

Commit History

Commits on Jan 31, 2025

• adds olympiad bench (huggingface#521)

  Show description for d332207
  NathanHB

  authored
  d332207

  Copy full SHA for d332207

Commits on Jan 6, 2025

• Update README.md (huggingface#486)

  NathanHB

  authored
  f6fee3a

  Copy full SHA for f6fee3a

Commits on Jan 2, 2025

• fix model parallel (huggingface#481)

  Show description for 24afde2
  NathanHB

  authored
  24afde2

  Copy full SHA for 24afde2

Commits on Dec 9, 2024

• option to list custom tasks (huggingface#425)

  NathanHB

  authored
  f2d0a65

  Copy full SHA for f2d0a65

Commits on Dec 5, 2024

• redo logging (huggingface#415)

  Show description for 1fb7968
  NathanHB

  authored
  1fb7968

  Copy full SHA for 1fb7968

Commits on Dec 4, 2024

• Nathan refacto cli (huggingface#407)

  Show description for 6e2754e
  NathanHB

  authored
  6e2754e

  Copy full SHA for 6e2754e

Commits on Nov 25, 2024

• Fix splitting for generative tasks (huggingface#400)

  Show description for ea46419
  

  NathanHB

  and

  clefourrier

  authored
  ea46419

  Copy full SHA for ea46419

Commits on Oct 16, 2024

• adds openai models (huggingface#359)

  NathanHB

  authored
  8b47ec1

  Copy full SHA for 8b47ec1

Commits on Oct 8, 2024

• Nathan llm judge quickfix (huggingface#350)

  Show description for b8923aa
  

  NathanHB

  and

  clefourrier

  authored
  b8923aa

  Copy full SHA for b8923aa

Commits on Oct 7, 2024

• Nathan llm judge quickfix (huggingface#348)

  Show description for a6cf5cb
  

  NathanHB

  and

  clefourrier

  authored
  a6cf5cb

  Copy full SHA for a6cf5cb

• fix (huggingface#347)

  Show description for cf40366
  

  NathanHB

  and

  clefourrier

  authored
  cf40366

  Copy full SHA for cf40366

• bump lighteval versoin (huggingface#328)

  Show description for f89ae20
  

  NathanHB

  and

  clefourrier

  authored
  f89ae20

  Copy full SHA for f89ae20

• refacto judge and add mixeval (huggingface#337)

  Show description for 0483bef
  

  NathanHB

  and

  clefourrier

  authored
  0483bef

  Copy full SHA for 0483bef

Commits on Sep 24, 2024

• readme rewrite (huggingface#327)

  Show description for ba20248
  

  NathanHB

  and

  clefourrier

  authored
  ba20248

  Copy full SHA for ba20248

• [FIX] Fixes vllm backend (huggingface#317)

  Show description for 4b06b94
  NathanHB

  authored
  4b06b94

  Copy full SHA for 4b06b94

Commits on Sep 16, 2024

• fix doc in readme (huggingface#303)

  Show description for 7295c78
  

  NathanHB

  and

  clefourrier

  authored
  7295c78

  Copy full SHA for 7295c78

Commits on Sep 15, 2024

• fix readme doc about custom tasks (huggingface#300)

  Show description for 3dd7d50
  

  NathanHB

  and

  clefourrier

  authored
  3dd7d50

  Copy full SHA for 3dd7d50

• Fixes bug: You can't create a model without either a list of model_args or a model_config_path when model_config_path was submited (huggingface#298)

  Show description for 8d83356
  

  NathanHB

  and

  clefourrier

  authored
  8d83356

  Copy full SHA for 8d83356

Commits on Sep 6, 2024

• bump dev version to 0.5.0 (huggingface#291)

  NathanHB

  authored
  7261d80

  Copy full SHA for 7261d80

Commits on Sep 5, 2024

• bump nltk version (huggingface#290)

  NathanHB

  authored
  279a9f2

  Copy full SHA for 279a9f2

Commits on Sep 3, 2024

• add vlmm backend (huggingface#274)

  Show description for 21934d5
  

  NathanHB

  and

  clefourrier

  authored
  21934d5

  Copy full SHA for 21934d5

Commits on Sep 2, 2024

• fix nanotron (huggingface#283)

  Show description for cdeb6c2
  

  NathanHB

  and

  hynky1999

  authored
  cdeb6c2

  Copy full SHA for cdeb6c2

Commits on Aug 19, 2024

• updates ifeval repo (huggingface#268)

  Show description for cf87de9
  NathanHB

  authored
  cf87de9

  Copy full SHA for cf87de9

Commits on Aug 16, 2024

• fix the location of tasks list in the readme (huggingface#267)

  NathanHB

  authored
  194e742

  Copy full SHA for 194e742

• change priority when choosing model dtype (huggingface#263)

  NathanHB

  authored
  5c1ae85

  Copy full SHA for 5c1ae85

Commits on Aug 14, 2024

• Fix missing json file (huggingface#264)

  Show description for 01a5129
  NathanHB

  authored
  01a5129

  Copy full SHA for 01a5129

• adds llm as judge using transformers (huggingface#223)

  Show description for cb32024
  

  3 peopleauthored
  cb32024

  Copy full SHA for cb32024

Commits on Jul 17, 2024

• launch lighteval using lighteval --args (huggingface#152)

  Show description for 4550cb7
  

  3 peopleauthored
  4550cb7

  Copy full SHA for 4550cb7

Commits on Jul 4, 2024

• fix llm as judge warnings (huggingface#173)

  Show description for 3a80833
  

  3 peopleauthored
  3a80833

  Copy full SHA for 3a80833

Commits on May 3, 2024

• adding aimo custom eval (huggingface#154)

  Show description for 9e3078e
  

  4 peopleauthored
  9e3078e

  Copy full SHA for 9e3078e

Commits on Apr 30, 2024

• Fix citation section in readme (huggingface#180)

  Show description for 6183bf2
  

  3 peopleauthored
  6183bf2

  Copy full SHA for 6183bf2

Commits on Apr 29, 2024

• add 'cite as' section in readme (huggingface#178)

  Show description for 9806093
  

  3 peopleauthored
  9806093

  Copy full SHA for 9806093

Commits on Apr 16, 2024

• Nathan add logging to metrics (huggingface#157)

  Show description for 6a48e4e
  

  NathanHB

  and

  Nathan Habib

  authored
  6a48e4e

  Copy full SHA for 6a48e4e

Commits on Apr 11, 2024

• Add llm as judge in metrics (huggingface#146)

  Show description for 7f6f807
  NathanHB

  authored
  7f6f807

  Copy full SHA for 7f6f807

Commits on Apr 2, 2024

• commit (huggingface#137)

  Show description for 017581f
  

  NathanHB

  and

  Nathan Habib

  authored
  017581f

  Copy full SHA for 017581f

Pagination

Previous

Next