Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 14, 2024

• Traceable LayerNorm (#1864)

  yanboliang

  authored
  73375b3

Commits on Dec 9, 2024

• Traceable RMSNorm part 2: non affine fused rms norm (#1862)

  Show description for 2863aa0
  yanboliang

  authored
  2863aa0

Commits on Dec 5, 2024

• use mem pool API for NCCL zero-copy (#1863)

  Aidyn-A

  authored
  9470501

Commits on Nov 28, 2024

• Traceable RMSNorm (#1861)

  yanboliang

  authored
  ac8214e

Commits on Nov 26, 2024

• [test] update fix of #1859 (#1860)

  eqy

  authored
  a1df804

Commits on Nov 23, 2024

• Update distributed_test_base.py (#1859)

  eqy

  authored
  683d71b

Commits on Nov 21, 2024

• Update test_group_norm.py (#1858)

  eqy

  authored
  97d8a6b

Commits on Nov 1, 2024

• Tensor.type() -> Tensor.scalar_type() (#1855)

  Show description for e552ad9
  crcrpar

  authored
  e552ad9

• manual impl when compiling (#1854)

  alexdremov

  authored
  e5e8b89

Commits on Oct 17, 2024

• Avoid NCCL collective coalescing in distopt when not needed (#1847)

  Show description for 6102d2c
  timmoon10

  authored
  6102d2c

Commits on Sep 28, 2024

• remove run_transformer from default lists (#1830)

  crcrpar

  authored
  e13011f

Commits on Aug 30, 2024

• Add Unittest For Distributed Adam With CUDA Graph (#1836)

  Show description for b7a4acc
  

  alpha0422

  and

  crcrpar

  authored
  b7a4acc

• Reformat grad_output if it's not channels last. (#1837)

  alpha0422

  authored
  c3e4adf

• Enhance Distributed Fused Adam (#1832)

  Show description for 7d5ecf1
  

  alpha0422

  and

  timmoon10

  authored
  7d5ecf1

• Traceable GroupNorm (#1835)

  Show description for 2d2db12
  

  alpha0422

  and

  crcrpar

  authored
  2d2db12

Commits on Aug 19, 2024

• add **kwargs to DistributedTestBase._run (#1829)

  xwang233

  authored
  7001836

Commits on Aug 17, 2024

• Fix illegal memory access with multi_tensor_apply size above INT_MAX (#1825)

  Show description for 79e3dc4
  gdb

  authored
  79e3dc4

Commits on Jul 25, 2024

• Allow Configurable Cache Directory (#1821)

  Show description for 59b80ee
  leimao

  authored
  59b80ee

Commits on Jul 24, 2024

• Do not monkey-patch class methods when registering distopt pre-forward hooks (#1820)

  Show description for f9f19d5
  timmoon10

  authored
  f9f19d5

Commits on Jul 2, 2024

• release gil (#1816)

  Show description for 23c1f86
  crcrpar

  authored
  23c1f86

Commits on Jun 29, 2024

• deprecate uses of torch.cuda.amp (#1813)

  Show description for f8e60c4
  Fuzzkatt

  authored
  f8e60c4

Commits on Jun 8, 2024

• Use torch.testing.all_close instead of get_max_diff in test_lamb.py (#1806)

  Fuzzkatt

  authored
  7b73b12

Commits on Apr 26, 2024

• Fix reduce_blocks_into_lanes race condition (#1798)

  Show description for a7de60e
  Fuzzkatt

  authored
  a7de60e

Commits on Apr 24, 2024

• NCCL userbuffer for DP RS in DistOpt (#1797)

  Show description for f3f0492
  

  3 peopleauthored
  f3f0492

• Add nccl_allocator for zero-copy user buffer (#1796)

  Show description for 6038fc1
  Aidyn-A

  authored
  6038fc1

Commits on Apr 19, 2024

• Add 2D Fused RoPE (#1784)

  Show description for b5df1cc
  yaox12

  authored
  b5df1cc

• move to correct device for v1 state (#1783)

  acphile

  authored
  c5f6b79

Commits on Mar 12, 2024

• Update test_fused_softmax.py (#1782)

  eqy

  authored
  810ffae

Commits on Feb 8, 2024

• Support scaled optimizer state in distributed Adam optimizer (#1771)

  Show description for b496d85
  timmoon10

  authored
  b496d85

Commits on Feb 7, 2024

• Add GPUDirect Storage (#1774)

  Show description for 5b67cd5
  Aidyn-A

  authored
  5b67cd5

• Skip the p2p test on single GPU platforms (#1775)

  nWEIdia

  authored
  7e239f7

Commits on Jan 25, 2024

• Update test_adam.py (#1772)

  eqy

  authored
  141bbf1

Commits on Jan 18, 2024

• Update test_bottleneck_module.py - Skip BottleNeck Peer Memory Test if Not Supported (#1769)

  Show description for 6c8f384
  nWEIdia

  authored
  6c8f384

Commits on Jan 12, 2024

• Update test_transducer_joint.py (#1767)

  Show description for 48c4894
  nWEIdia

  authored
  48c4894

• Fused RoPE for thd format (#1756)

  Show description for f058162
  yaox12

  authored
  f058162

Pagination

PreviousNext