Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 18, 2025

• Async transfer batch and block mask to cuda device (#212)

  Show description for d57965b
  apaz-cli

  authored
  d57965b

  Copy full SHA for d57965b

Commits on Feb 12, 2025

• remove reshard after forward for small model

  Show description for 92db001
  

  sami jaghouar

  authored and

  samsja

  committed
  92db001

  Copy full SHA for 92db001

• add 70m llama

  Show description for 44f1cbf
  

  sami jaghouar

  authored and

  samsja

  committed
  44f1cbf

  Copy full SHA for 44f1cbf

Commits on Feb 11, 2025

• Revert "Pipelined CPU Adam Optimizer (#214)"

  Show description for 34a3ff3
  

  apaz-cli

  authored and

  samsja

  committed
  34a3ff3

  Copy full SHA for 34a3ff3

• Pipelined CPU Adam Optimizer (#214)

  Show description for 7d77326
  apaz-cli

  authored
  7d77326

  Copy full SHA for 7d77326

Commits on Jan 30, 2025

• Optimizer state offload to CPU (#204)

  Show description for eabafad
  apaz-cli

  authored
  eabafad

  Copy full SHA for eabafad

• Add FSDP2 CPUOffloadPolicy and config (#207)

  Show description for c332f80
  apaz-cli

  authored
  c332f80

  Copy full SHA for c332f80

• Add liger z loss. (#206)

  Show description for a3db806
  apaz-cli

  authored
  a3db806

  Copy full SHA for a3db806

Commits on Jan 19, 2025

• Add liger fused linear/crossentropy (#201)

  Show description for 7274fb3
  

  apaz-cli

  and

  samsja

  authored
  7274fb3

  Copy full SHA for 7274fb3

Commits on Jan 18, 2025

• Add fastest adam hparams and update toposolve package (#202)

  Show description for f6e238a
  

  Jackmin801

  and

  samsja

  authored
  f6e238a

  Copy full SHA for f6e238a

Commits on Jan 16, 2025

• removed ununsed args (#197)

  samsja

  authored
  742aa1c

  Copy full SHA for 742aa1c

Commits on Jan 15, 2025

• Add named runs and get_env_config() (#194)

  Show description for 8bec8a8
  apaz-cli

  authored
  8bec8a8

  Copy full SHA for 8bec8a8

Commits on Jan 14, 2025

• Add profiling and chunked cross-entropy (#192)

  Show description for 57c68c6
  apaz-cli

  authored
  57c68c6

  Copy full SHA for 57c68c6

Commits on Jan 10, 2025

• add soap optimizer (#186)

  Show description for d958229
  samsja

  authored
  d958229

  Copy full SHA for d958229

• Split out config.py

  

  Your Name

  authored and

  samsja

  committed
  5b55480

  Copy full SHA for 5b55480

Commits on Dec 21, 2024

• simplify 1b config (#181)

  samsja

  authored
  163ddb8

  Copy full SHA for 163ddb8

Commits on Dec 11, 2024

• add simple 10b configs

  samsja

  committed
  337f731

  Copy full SHA for 337f731

Commits on Dec 6, 2024

• update short configs

  samsja

  committed
  36d1d35

  Copy full SHA for 36d1d35

• add reshard after forward

  samsja

  committed
  30a8a90

  Copy full SHA for 30a8a90

Commits on Dec 4, 2024

• add data rank split

  samsja

  committed
  d3c5470

  Copy full SHA for d3c5470

Commits on Nov 19, 2024

• remove ckpt interal from 1b config

  samsja

  committed
  21a3543

  Copy full SHA for 21a3543

• update configs

  samsja

  committed
  6e909cf

  Copy full SHA for 6e909cf

Commits on Nov 15, 2024

• hotfix: num stable steps

  samsja

  committed
  efdf227

  Copy full SHA for efdf227

• add cool down config

  samsja

  committed
  f11f460

  Copy full SHA for f11f460

Commits on Nov 12, 2024

• save data ckpt locally

  samsja

  committed
  f41230c

  Copy full SHA for f41230c

Commits on Nov 5, 2024

• add custom parquet and interleave datasets (#130)

  Show description for fa7845a
  

  samsja

  and

  Jackmin801

  authored
  fa7845a

  Copy full SHA for fa7845a

Commits on Nov 2, 2024

• 1b config (#137)

  Show description for 1eda079
  samsja

  authored
  1eda079

  Copy full SHA for 1eda079

Commits on Oct 29, 2024

• remove wandb resume

  samsja

  committed
  f3036e6

  Copy full SHA for f3036e6

Commits on Oct 22, 2024

• update 10b config for new run restart

  samsja

  committed
  2a9351b

  Copy full SHA for 2a9351b

• add skip dataset (#126)

  Show description for 9a37ad2
  samsja

  authored
  9a37ad2

  Copy full SHA for 9a37ad2

Commits on Oct 19, 2024

• Fix tests (#120)

  Show description for 3946461
  samsja

  authored
  3946461

  Copy full SHA for 3946461

Commits on Oct 18, 2024

• re enable data push

  samsja

  committed
  9ad8077

  Copy full SHA for 9ad8077

Commits on Oct 16, 2024

• proper ckpt recovery (#113)

  Show description for 155f83c
  samsja

  authored
  155f83c

  Copy full SHA for 155f83c

Commits on Oct 15, 2024

• Add script to pull subset of data (#111)

  Show description for 816c040
  Jackmin801

  authored
  816c040

  Copy full SHA for 816c040

Commits on Oct 14, 2024

• hotfix:remove data path gs

  samsja

  committed
  c7e8848

  Copy full SHA for c7e8848

Pagination

Previous

Next