Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 29, 2024

• update on alpaca

  

  Yu

  committed
  11441e2

  Copy full SHA for 11441e2

• update on att clip

  

  Yu

  committed
  a758969

  Copy full SHA for a758969

Commits on Jan 3, 2024

• Release human evaluation interface and tulu 1 human eval data. (allenai#96)

  Show description for 9ebcb58
  yizhongw

  authored
  9ebcb58

  Copy full SHA for 9ebcb58

Commits on Nov 29, 2023

• add dpo scripts; docker; readme (allenai#86)

  Show description for 60ceefa
  hamishivi

  authored
  60ceefa

  Copy full SHA for 60ceefa

Commits on Nov 24, 2023

• Use hf tokenizer in data preprocessing for portability (allenai#80)

  hamishivi

  authored
  d61037f

  Copy full SHA for d61037f

Commits on Nov 19, 2023

• fix zephyr template

  hamishivi

  committed
  65c6f40

  Copy full SHA for 65c6f40

Commits on Nov 17, 2023

• Fix several issues in the evals. (allenai#79)

  Show description for 4a2e9dd
  yizhongw

  authored
  4a2e9dd

  Copy full SHA for 4a2e9dd

Commits on Oct 29, 2023

• Update demonstration eval scripts.

  yizhongw

  committed
  b555637

  Copy full SHA for b555637

• Evals for more models.

  yizhongw

  committed
  a8780d7

  Copy full SHA for a8780d7

• Save AlpacaEval cache to customized folder.

  yizhongw

  committed
  c0a998d

  Copy full SHA for c0a998d

Commits on Oct 22, 2023

• Default max generation length to be 8192 for alpaca eval.

  yizhongw

  committed
  409ebc1

  Copy full SHA for 409ebc1

Commits on Oct 21, 2023

• Merge branch 'refine_parsing_in_evals' of github.com:allenai/open-instruct into refine_parsing_in_evals

  yizhongw

  committed
  4977175

  Copy full SHA for 4977175

• Fix the max_num_batched_tokens error in vllm.

  yizhongw

  committed
  c93a41e

  Copy full SHA for c93a41e

Commits on Oct 19, 2023

• Minor fix about comment

  yizhongw

  committed
  04a3b76

  Copy full SHA for 04a3b76

• Update ids for model checkpoints.

  yizhongw

  committed
  578b1a5

  Copy full SHA for 578b1a5

• Fix a bug about stop sequences in TrutufulQA.

  yizhongw

  committed
  25f265a

  Copy full SHA for 25f265a

• Remove the prepended space token in codex generation, since vllm has fixed it.

  yizhongw

  committed
  d228d74

  Copy full SHA for d228d74

• update eval job submission script.

  yizhongw

  committed
  3faa603

  Copy full SHA for 3faa603

• Update default eval beaker config.

  yizhongw

  committed
  ef01694

  Copy full SHA for ef01694

• Clean evaluation data preparation.

  yizhongw

  committed
  1411632

  Copy full SHA for 1411632

• Use the official setup of alpaca eval by default.

  yizhongw

  committed
  103c078

  Copy full SHA for 103c078

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  09613af

  Copy full SHA for 09613af

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  6b038fc

  Copy full SHA for 6b038fc

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  677cbd0

  Copy full SHA for 677cbd0

• Refine the prompting and parsing for Toxigen and fix some bugs.

  yizhongw

  committed
  e11dd37

  Copy full SHA for e11dd37

• Refine the prompting and parsing for TydiQA.

  yizhongw

  committed
  b36f5b6

  Copy full SHA for b36f5b6

• Refine the prompting and parsing for GSM.

  yizhongw

  committed
  bb45970

  Copy full SHA for bb45970

• Refine the prompting and parsing for BBH.

  yizhongw

  committed
  720159a

  Copy full SHA for 720159a

• Restrict pytorch version to <= 2.0.1, since 2.1.0 leads to crash.

  yizhongw

  committed
  4ab022a

  Copy full SHA for 4ab022a

Commits on Oct 16, 2023

• Switch to using the built-in flash attention 2 support in Transformers library. (allenai#73)

  Show description for 98ccfb4
  yizhongw

  authored
  98ccfb4

  Copy full SHA for 98ccfb4

• Minor fix about comment

  yizhongw

  committed
  a65c519

  Copy full SHA for a65c519

• Update ids for model checkpoints.

  yizhongw

  committed
  f77188d

  Copy full SHA for f77188d

• Fix a bug about stop sequences in TrutufulQA.

  yizhongw

  committed
  700c621

  Copy full SHA for 700c621

• Remove the prepended space token in codex generation, since vllm has fixed it.

  yizhongw

  committed
  d8a922b

  Copy full SHA for d8a922b

Commits on Oct 10, 2023

• update eval job submission script.

  yizhongw

  committed
  1a88310

  Copy full SHA for 1a88310

Pagination

Previous

Next