Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 29, 2024

• update on att clip

  

  Yu

  committed
  a758969

  Copy full SHA for a758969

Commits on Nov 19, 2023

• fix zephyr template

  hamishivi

  committed
  65c6f40

  Copy full SHA for 65c6f40

Commits on Nov 17, 2023

• Fix several issues in the evals. (allenai#79)

  Show description for 4a2e9dd
  yizhongw

  authored
  4a2e9dd

  Copy full SHA for 4a2e9dd

Commits on Oct 29, 2023

• Save AlpacaEval cache to customized folder.

  yizhongw

  committed
  c0a998d

  Copy full SHA for c0a998d

Commits on Oct 22, 2023

• Default max generation length to be 8192 for alpaca eval.

  yizhongw

  committed
  409ebc1

  Copy full SHA for 409ebc1

Commits on Oct 21, 2023

• Fix the max_num_batched_tokens error in vllm.

  yizhongw

  committed
  c93a41e

  Copy full SHA for c93a41e

Commits on Oct 19, 2023

• Minor fix about comment

  yizhongw

  committed
  04a3b76

  Copy full SHA for 04a3b76

• Fix a bug about stop sequences in TrutufulQA.

  yizhongw

  committed
  25f265a

  Copy full SHA for 25f265a

• Remove the prepended space token in codex generation, since vllm has fixed it.

  yizhongw

  committed
  d228d74

  Copy full SHA for d228d74

• Use the official setup of alpaca eval by default.

  yizhongw

  committed
  103c078

  Copy full SHA for 103c078

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  09613af

  Copy full SHA for 09613af

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  6b038fc

  Copy full SHA for 6b038fc

• Support batch eval for trutufulqa mc setup.

  yizhongw

  committed
  677cbd0

  Copy full SHA for 677cbd0

• Refine the prompting and parsing for Toxigen and fix some bugs.

  yizhongw

  committed
  e11dd37

  Copy full SHA for e11dd37

• Refine the prompting and parsing for TydiQA.

  yizhongw

  committed
  b36f5b6

  Copy full SHA for b36f5b6

• Refine the prompting and parsing for GSM.

  yizhongw

  committed
  bb45970

  Copy full SHA for bb45970

• Refine the prompting and parsing for BBH.

  yizhongw

  committed
  720159a

  Copy full SHA for 720159a

Commits on Sep 29, 2023

• Specifying the alpaca eval reference path as the regenerated version with 2048 max tokens.

  yizhongw

  committed
  171c3f1

  Copy full SHA for 171c3f1

Commits on Sep 26, 2023

• Use latest alpaca_eval library to evaluate performance on alpaca farm. (allenai#63)

  Show description for 63f870d
  yizhongw

  authored
  63f870d

  Copy full SHA for 63f870d

Commits on Sep 25, 2023

• Fix a bug in tydiaqa model loading.

  yizhongw

  committed
  ae27904

  Copy full SHA for ae27904

• fix device error in toxigen eval

  yizhongw

  committed
  4a8bba3

  Copy full SHA for 4a8bba3

Commits on Sep 24, 2023

• Support using vllm for running Toxigen.

  yizhongw

  committed
  a9ac11f

  Copy full SHA for a9ac11f

• Support using vllm for running TydiQA

  yizhongw

  committed
  d3809db

  Copy full SHA for d3809db

• Support using vllm for running GSM

  yizhongw

  committed
  9fe582e

  Copy full SHA for 9fe582e

• Support using vllm for running BBH

  yizhongw

  committed
  2a13f1b

  Copy full SHA for 2a13f1b

• Support using vllm for running codex humaneval.

  yizhongw

  committed
  d6d439b

  Copy full SHA for d6d439b

Commits on Sep 22, 2023

• Merge pull request allenai#62 from OyvindTafjord/fix-logprobs

  Show description for 12950e0
  yizhongw

  authored
  12950e0

  Copy full SHA for 12950e0

• Use fast tokenizer by default.

  yizhongw

  committed
  28d5366

  Copy full SHA for 28d5366

• Update comment

  OyvindTafjord

  committed
  2285ef2

  Copy full SHA for 2285ef2

• Fix merge issue

  OyvindTafjord

  committed
  ef0d437

  Copy full SHA for ef0d437

• Merge remote-tracking branch 'upstream/main' into fix-logprobs

  OyvindTafjord

  committed
  0ddab2b

  Copy full SHA for 0ddab2b

• Fix MMLU answer prompts and logprobs normalization

  OyvindTafjord

  committed
  ad2385f

  Copy full SHA for ad2385f

Commits on Sep 17, 2023

• Fix a bug in iterating in eval/predict.py

  yizhongw

  committed
  cbc02e9

  Copy full SHA for cbc02e9

Commits on Sep 15, 2023

• Merge pull request allenai#59 from allenai/qlora

  Show description for 376ebd4
  yizhongw

  authored
  376ebd4

  Copy full SHA for 376ebd4

• Fixes

  hamishivi

  committed
  68d5e1d

  Copy full SHA for 68d5e1d

Pagination

Previous

Next