Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 17, 2024

• Fine-tuning with label mask

  Show description for 321c499
  epwalsh

  committed
  321c499

  Copy full SHA for 321c499

Commits on Dec 20, 2023

• allow init params

  hamishivi

  committed
  0a11fe4

  Copy full SHA for 0a11fe4

Commits on Dec 11, 2023

• run hf_olmo tests too

  AkshitaB

  committed
  0c8bcd5

  Copy full SHA for 0c8bcd5

Commits on Dec 9, 2023

• style check

  AkshitaB

  committed
  68ff059

  Copy full SHA for 68ff059

• fix test

  AkshitaB

  committed
  64118d6

  Copy full SHA for 64118d6

• simplify tokenizer

  AkshitaB

  committed
  9aca8e1

  Copy full SHA for 9aca8e1

Commits on Dec 8, 2023

• add test for save_pretrained

  AkshitaB

  committed
  81776a5

  Copy full SHA for 81776a5

Commits on Dec 7, 2023

• ensure checkpoint filename is present

  AkshitaB

  committed
  8f456c2

  Copy full SHA for 8f456c2

Commits on Dec 6, 2023

• self-contained hf-olmo modeling code

  AkshitaB

  committed
  b7e403f

  Copy full SHA for b7e403f

Commits on Nov 17, 2023

• ensure global batch size always given

  epwalsh

  committed
  e249e8d

  Copy full SHA for e249e8d

Commits on Nov 7, 2023

• Add gradient clipping warmup (allenai#363)

  epwalsh

  authored
  6c0e419

  Copy full SHA for 6c0e419

Commits on Oct 27, 2023

• Fix loading unsharded optim state with different block group size

  epwalsh

  committed
  740294f

  Copy full SHA for 740294f

Commits on Oct 26, 2023

• Add option to FSDP wrap by groups of blocks (allenai#340)

  epwalsh

  authored
  cd73387

  Copy full SHA for cd73387

Commits on Oct 25, 2023

• Move remaining checkpointing logic to Checkpointer class (allenai#331)

  epwalsh

  authored
  104d1ce

  Copy full SHA for 104d1ce

Commits on Oct 10, 2023

• Features to match OpenLM (allenai#302)

  epwalsh

  authored
  fddded5

  Copy full SHA for fddded5

Commits on Oct 8, 2023

• Refactor checkpointing, bring back legacy sharded checkpointing as the default (allenai#316)

  Show description for d2e84fe
  

  epwalsh

  and

  ibeltagy

  authored
  d2e84fe

  Copy full SHA for d2e84fe

Commits on Oct 5, 2023

• Formatting

  dirkgr

  committed
  54b624a

  Copy full SHA for 54b624a

• Adds tests, and fixes based on the tests

  dirkgr

  committed
  7d71a33

  Copy full SHA for 7d71a33

Commits on Sep 26, 2023

• Add linear scheduler

  epwalsh

  committed
  35ad73f

  Copy full SHA for 35ad73f

Commits on Sep 7, 2023

• Bring back AMD layer norm

  dirkgr

  committed
  7b1cc40

  Copy full SHA for 7b1cc40

Commits on Sep 6, 2023

• Buffers don't require grad by default

  dirkgr

  committed
  735f2ef

  Copy full SHA for 735f2ef

• isort

  dirkgr

  committed
  034f913

  Copy full SHA for 034f913

• Add test for layer norm

  dirkgr

  committed
  02fa580

  Copy full SHA for 02fa580

Commits on Sep 5, 2023

• Fold the bug fix into the normal LN implementation

  dirkgr

  committed
  70a1c82

  Copy full SHA for 70a1c82

Commits on Sep 4, 2023

• Adds a manually implemented layer norm

  Show description for fa0bc30
  dirkgr

  committed
  fa0bc30

  Copy full SHA for fa0bc30

Commits on Aug 24, 2023

• Training improvements (allenai#239)

  Show description for 9071816
  

  epwalsh

  and

  ananyahjha93

  authored
  9071816

  Copy full SHA for 9071816

Commits on Jul 27, 2023

• improve config resolution

  epwalsh

  committed
  3e8163e

  Copy full SHA for 3e8163e

Commits on Jul 11, 2023

• Don't reshuffle eval data each "epoch" (allenai#229)

  epwalsh

  authored
  952819b

  Copy full SHA for 952819b

Commits on Jul 8, 2023

• fix unrelated test

  AkshitaB

  committed
  dd4f48c

  Copy full SHA for dd4f48c

Commits on Jul 6, 2023

• add more tests for memmap dataset

  epwalsh

  committed
  970a77c

  Copy full SHA for 970a77c

Commits on Jun 26, 2023

• fix finally

  AkshitaB

  committed
  833e4f5

  Copy full SHA for 833e4f5

• fix

  AkshitaB

  committed
  89aaf97

  Copy full SHA for 89aaf97

• rename to hf_olmo

  AkshitaB

  committed
  72248f0

  Copy full SHA for 72248f0

• use HF's default generation tools

  AkshitaB

  committed
  7abd90f

  Copy full SHA for 7abd90f

Commits on Jun 23, 2023

• move imports

  AkshitaB

  committed
  754eff1

  Copy full SHA for 754eff1

Pagination

Previous

Next