Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 5, 2023

• Use dynamic function import in prediction

  yizhongw

  committed
  6249fd1

  Copy full SHA for 6249fd1

Commits on Sep 4, 2023

• Use import_module to dynamically import the chat formatting function, allowing more flexibility for user-defined formatting.

  yizhongw

  committed
  1a35973

  Copy full SHA for 1a35973

Commits on Sep 3, 2023

• Remove mgsm and superni from the evaluation set, since they are not used.

  yizhongw

  committed
  2c54b5e

  Copy full SHA for 2c54b5e

• Remove lines that were commented out.

  yizhongw

  committed
  a155e6c

  Copy full SHA for a155e6c

• Merge branch 'main' into add_eval

  yizhongw

  committed
  4560fdc

  Copy full SHA for 4560fdc

• Use chat_formatting_function to specify which prompt encoding function the evals should use.

  yizhongw

  committed
  5d6264a

  Copy full SHA for 5d6264a

Commits on Sep 2, 2023

• Support LLaMa2 chat format.

  yizhongw

  committed
  ed2cded

  Copy full SHA for ed2cded

Commits on Aug 18, 2023

• Merge pull request allenai#48 from allenai/add_eval

  Show description for 851ebf3
  yizhongw

  authored
  851ebf3

  Copy full SHA for 851ebf3

• minor fix for toxigen

  hamishivi

  committed
  c3ccc04

  Copy full SHA for c3ccc04

• Merge branch 'main' into add_eval

  yizhongw

  committed
  12355b0

  Copy full SHA for 12355b0

• refine truthfulqa eval

  yizhongw

  committed
  c6c2bb6

  Copy full SHA for c6c2bb6

Commits on Aug 17, 2023

• various cleanups, new dockerfile for vllm

  hamishivi

  committed
  d1e2ed8

  Copy full SHA for d1e2ed8

• Use different prompts for toxigen

  hamishivi

  committed
  57d413a

  Copy full SHA for 57d413a

• Add trutufulqa evalaution.

  yizhongw

  committed
  db2e491

  Copy full SHA for db2e491

• fix up code.

  hamishivi

  committed
  61575b6

  Copy full SHA for 61575b6

Commits on Aug 16, 2023

• add toxigen code and update readme

  hamishivi

  committed
  766a29c

  Copy full SHA for 766a29c

Commits on Aug 14, 2023

• Manually set the max length of OPT/Pythia tokenizers.

  yizhongw

  committed
  d97721e

  Copy full SHA for d97721e

• limit the length within 2048 tokens in MMLU eval even with chat format.

  yizhongw

  committed
  cd54d08

  Copy full SHA for cd54d08

• fix missing import in running tydiqa eval

  yizhongw

  committed
  e011a5c

  Copy full SHA for e011a5c

• minor fix

  

  yizhongw

  authored and

  Yizhong Wang

  committed
  3af76e3

  Copy full SHA for 3af76e3

• Add eval/predict.py for more generic use cases.

  yizhongw

  committed
  273f118

  Copy full SHA for 273f118

• Fix a bug: when loading models, the code now will use auto torch_dtype, and only convert to half if the user explicitly specify that.

  yizhongw

  committed
  d649539

  Copy full SHA for d649539

• Fix a bug: when loading models, the code now will use auto torch_dtype, and only convert to half if the user explicitly specify that.

  yizhongw

  committed
  9cad3d2

  Copy full SHA for 9cad3d2

• Fix a bug: during evaluation, we add back special token by default.

  yizhongw

  committed
  52ed964

  Copy full SHA for 52ed964

Commits on Jul 31, 2023

• remove xorqa

  yizhongw

  committed
  b3176b4

  Copy full SHA for b3176b4

Commits on Jul 24, 2023

• fix a bug in keyword stopping criteria

  yizhongw

  committed
  b156a22

  Copy full SHA for b156a22

Commits on Jul 5, 2023

• tokenizer and typing fixes

  hamishivi

  committed
  dfd49a8

  Copy full SHA for dfd49a8

Commits on Jun 9, 2023

• initial commit

  hamishivi

  committed
  e44fcf5

  Copy full SHA for e44fcf5

Loading

Pagination

Previous

Next