Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 18, 2025

• Async transfer batch and block mask to cuda device (#212)

  Show description for d57965b
  apaz-cli

  authored
  d57965b

  Copy full SHA for d57965b

Commits on Feb 14, 2025

• remove http monitor

  Show description for d211188
  samsja

  committed
  d211188

  Copy full SHA for d211188

Commits on Feb 12, 2025

• add 70m llama

  Show description for 44f1cbf
  

  sami jaghouar

  authored and

  samsja

  committed
  44f1cbf

  Copy full SHA for 44f1cbf

Commits on Feb 11, 2025

• Revert "Pipelined CPU Adam Optimizer (#214)"

  Show description for 34a3ff3
  

  apaz-cli

  authored and

  samsja

  committed
  34a3ff3

  Copy full SHA for 34a3ff3

• Pipelined CPU Adam Optimizer (#214)

  Show description for 7d77326
  apaz-cli

  authored
  7d77326

  Copy full SHA for 7d77326

Commits on Feb 5, 2025

• Stopwatch as a context manager (#211)

  Show description for ced4ca7
  apaz-cli

  authored
  ced4ca7

  Copy full SHA for ced4ca7

Commits on Feb 1, 2025

• Revert "Add stopwatch timer to train.py (#208)"

  Show description for cd7be3d
  samsja

  committed
  cd7be3d

  Copy full SHA for cd7be3d

Commits on Jan 31, 2025

• Add stopwatch timer to train.py (#208)

  Show description for 0eee152
  apaz-cli

  authored
  0eee152

  Copy full SHA for 0eee152

Commits on Jan 30, 2025

• Optimizer state offload to CPU (#204)

  Show description for eabafad
  apaz-cli

  authored
  eabafad

  Copy full SHA for eabafad

• Add FSDP2 CPUOffloadPolicy and config (#207)

  Show description for c332f80
  apaz-cli

  authored
  c332f80

  Copy full SHA for c332f80

• Add liger z loss. (#206)

  Show description for a3db806
  apaz-cli

  authored
  a3db806

  Copy full SHA for a3db806

Commits on Jan 26, 2025

• add grad norm logging

  samsja

  committed
  98685cc

  Copy full SHA for 98685cc

Commits on Jan 19, 2025

• Add liger fused linear/crossentropy (#201)

  Show description for 7274fb3
  

  apaz-cli

  and

  samsja

  authored
  7274fb3

  Copy full SHA for 7274fb3

Commits on Jan 17, 2025

• Replace get_env_config() with resolve_env_vars(). (#198)

  Show description for ea4aa53
  

  apaz-cli

  and

  samsja

  authored
  ea4aa53

  Copy full SHA for ea4aa53

Commits on Jan 16, 2025

• removed ununsed args (#197)

  samsja

  authored
  742aa1c

  Copy full SHA for 742aa1c

• fix wandb config run name (#195)

  samsja

  authored
  39b3c5e

  Copy full SHA for 39b3c5e

Commits on Jan 15, 2025

• Add named runs and get_env_config() (#194)

  Show description for 8bec8a8
  apaz-cli

  authored
  8bec8a8

  Copy full SHA for 8bec8a8

Commits on Jan 14, 2025

• Add profiling and chunked cross-entropy (#192)

  Show description for 57c68c6
  apaz-cli

  authored
  57c68c6

  Copy full SHA for 57c68c6

Commits on Jan 10, 2025

• add soap optimizer (#186)

  Show description for d958229
  samsja

  authored
  d958229

  Copy full SHA for d958229

• fix diloco not defined

  samsja

  committed
  a22f434

  Copy full SHA for a22f434

• Pass ruff check

  

  Your Name

  authored and

  samsja

  committed
  be3ef20

  Copy full SHA for be3ef20

• Comment out profiler by default. Gotta figure out how to use the config files.

  

  Your Name

  authored and

  samsja

  committed
  818e671

  Copy full SHA for 818e671

• Split out config.py

  

  Your Name

  authored and

  samsja

  committed
  5b55480

  Copy full SHA for 5b55480

Commits on Jan 6, 2025

• refactor math attn to attn fn

  samsja

  committed
  5a76acb

  Copy full SHA for 5a76acb

Commits on Dec 23, 2024

• remove useless memory stuff

  samsja

  committed
  4715633

  Copy full SHA for 4715633

• add ckpt tests

  samsja

  committed
  a2bb051

  Copy full SHA for a2bb051

• use shared function for log modelhash

  samsja

  committed
  ce171f8

  Copy full SHA for ce171f8

Commits on Dec 10, 2024

• deprecated fa2 and use flex attention (#166)

  Show description for a116ef1
  samsja

  authored
  a116ef1

  Copy full SHA for a116ef1

Commits on Dec 4, 2024

• add install cript

  samsja

  committed
  fe84fef

  Copy full SHA for fe84fef

• add data rank split

  samsja

  committed
  d3c5470

  Copy full SHA for d3c5470

Commits on Nov 22, 2024

• add fake tokenizer for running test without hf token

  samsja

  committed
  4768311

  Copy full SHA for 4768311

Commits on Nov 20, 2024

• update pings logging

  samsja

  committed
  ed7306b

  Copy full SHA for ed7306b

Commits on Nov 18, 2024

• remove ring optimization when not enable

  samsja

  committed
  cc36033

  Copy full SHA for cc36033

Commits on Nov 14, 2024

• make live reco send blocking

  samsja

  committed
  a01904c

  Copy full SHA for a01904c

• allow to do remote data load with live reco

  samsja

  committed
  f9106d9

  Copy full SHA for f9106d9

Pagination

Previous

Next