Commits

Branch selector

 main

User selector

yizhongw

Datepicker

All time

Commit History

Commits on Jan 3, 2024

• Release human evaluation interface and tulu 1 human eval data. (allenai#96)

  Show description for 9ebcb58
  yizhongw

  authored
  9ebcb58

  Copy full SHA for 9ebcb58

Commits on Nov 17, 2023

• Fix several issues in the evals. (allenai#79)

  Show description for 4a2e9dd
  yizhongw

  authored
  4a2e9dd

  Copy full SHA for 4a2e9dd

Commits on Oct 29, 2023

• Update demonstration eval scripts.

  yizhongw

  committed
  b555637

  Copy full SHA for b555637

• Evals for more models.

  yizhongw

  committed
  a8780d7

  Copy full SHA for a8780d7

• Save AlpacaEval cache to customized folder.

  yizhongw

  committed
  c0a998d

  Copy full SHA for c0a998d

Commits on Oct 22, 2023

• Default max generation length to be 8192 for alpaca eval.

  yizhongw

  committed
  409ebc1

  Copy full SHA for 409ebc1

Commits on Oct 21, 2023

• Merge branch 'refine_parsing_in_evals' of github.com:allenai/open-instruct into refine_parsing_in_evals

  yizhongw

  committed
  4977175

  Copy full SHA for 4977175

• Fix the max_num_batched_tokens error in vllm.

  yizhongw

  committed
  c93a41e

  Copy full SHA for c93a41e

Commits on Oct 19, 2023

• Minor fix about comment

  yizhongw

  committed
  04a3b76

  Copy full SHA for 04a3b76

• Update ids for model checkpoints.

  yizhongw

  committed
  578b1a5

  Copy full SHA for 578b1a5

• Fix a bug about stop sequences in TrutufulQA.

  yizhongw

  committed
  25f265a

  Copy full SHA for 25f265a

• Remove the prepended space token in codex generation, since vllm has fixed it.

  yizhongw

  committed
  d228d74

  Copy full SHA for d228d74

• update eval job submission script.

  yizhongw

  committed
  3faa603

  Copy full SHA for 3faa603

• Update default eval beaker config.

  yizhongw

  committed
  ef01694

  Copy full SHA for ef01694

• Clean evaluation data preparation.

  yizhongw

  committed
  1411632

  Copy full SHA for 1411632

• Use the official setup of alpaca eval by default.

  yizhongw

  committed
  103c078

  Copy full SHA for 103c078

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  09613af

  Copy full SHA for 09613af

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  6b038fc

  Copy full SHA for 6b038fc

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  677cbd0

  Copy full SHA for 677cbd0

• Refine the prompting and parsing for Toxigen and fix some bugs.

  yizhongw

  committed
  e11dd37

  Copy full SHA for e11dd37

• Refine the prompting and parsing for TydiQA.

  yizhongw

  committed
  b36f5b6

  Copy full SHA for b36f5b6

• Refine the prompting and parsing for GSM.

  yizhongw

  committed
  bb45970

  Copy full SHA for bb45970

• Refine the prompting and parsing for BBH.

  yizhongw

  committed
  720159a

  Copy full SHA for 720159a

• Restrict pytorch version to <= 2.0.1, since 2.1.0 leads to crash.

  yizhongw

  committed
  4ab022a

  Copy full SHA for 4ab022a

Commits on Oct 16, 2023

• Switch to using the built-in flash attention 2 support in Transformers library. (allenai#73)

  Show description for 98ccfb4
  yizhongw

  authored
  98ccfb4

  Copy full SHA for 98ccfb4

• Minor fix about comment

  yizhongw

  committed
  a65c519

  Copy full SHA for a65c519

• Update ids for model checkpoints.

  yizhongw

  committed
  f77188d

  Copy full SHA for f77188d

• Fix a bug about stop sequences in TrutufulQA.

  yizhongw

  committed
  700c621

  Copy full SHA for 700c621

• Remove the prepended space token in codex generation, since vllm has fixed it.

  yizhongw

  committed
  d8a922b

  Copy full SHA for d8a922b

Commits on Oct 10, 2023

• update eval job submission script.

  yizhongw

  committed
  1a88310

  Copy full SHA for 1a88310

• Update default eval beaker config.

  yizhongw

  committed
  17d3a1e

  Copy full SHA for 17d3a1e

• Clean evaluation data preparation.

  yizhongw

  committed
  59238d4

  Copy full SHA for 59238d4

• Use the official setup of alpaca eval by default.

  yizhongw

  committed
  cf7ff26

  Copy full SHA for cf7ff26

Commits on Oct 3, 2023

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  9ad0f44

  Copy full SHA for 9ad0f44

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  505184d

  Copy full SHA for 505184d

Pagination

Previous

Next