Commits

Branch selector

 main

User selector

hariharan-devarajan

Datepicker

All time

Commit History

Commits on Oct 17, 2024

• Bugfix: fix type of number for offset and size (#229)

  Show description for edb4b27
  hariharan-devarajan

  authored
  edb4b27

  Copy full SHA for edb4b27

Commits on Sep 24, 2024

• For sample indexing we fix the uneven sampling (#226)

  Show description for 3732663
  hariharan-devarajan

  authored
  3732663

  Copy full SHA for 3732663

Commits on Sep 3, 2024

• Improve CI Performance. (#227)

  Show description for bbe9bae
  hariharan-devarajan

  authored
  bbe9bae

  Copy full SHA for bbe9bae

Commits on Aug 28, 2024

• fix missing import for chunking. (#223)

  hariharan-devarajan

  authored
  d6924f3

  Copy full SHA for d6924f3

Commits on Aug 27, 2024

• Fixed iterator to only store data for that rank. (#216)

  Show description for 8cabad2
  hariharan-devarajan

  authored
  8cabad2

  Copy full SHA for 8cabad2

• Fixed mocking for DFTracer (#220)

  Show description for f764d93
  

  hariharan-devarajan

  and

  zhenghh04

  authored
  f764d93

  Copy full SHA for f764d93

Commits on Aug 13, 2024

• Ignore file indexing for native data loader. (#215)

  Show description for 866828c
  hariharan-devarajan

  authored
  866828c

  Copy full SHA for 866828c

• only intialize and finalize on DLIOMPI (#214)

  hariharan-devarajan

  authored
  5aec234

  Copy full SHA for 5aec234

• Update setup.py (#218)

  Show description for bd12736
  hariharan-devarajan

  authored
  bd12736

  Copy full SHA for bd12736

Commits on Jul 19, 2024

• Switch DLIO Profiler to DFTracer. (#208)

  Show description for cc4a1f5
  

  3 peopleauthored
  cc4a1f5

  Copy full SHA for cc4a1f5

Commits on Feb 24, 2024

• Fix sample shuffling (#154)

  Show description for ca8d6a3
  hariharan-devarajan

  authored
  ca8d6a3

  Copy full SHA for ca8d6a3

Commits on Feb 5, 2024

• fix random bugs and printing (#147)

  hariharan-devarajan

  authored
  b97c525

  Copy full SHA for b97c525

• Feature/parallel io generator (#148)

  Show description for 872df13
  hariharan-devarajan

  authored
  872df13

  Copy full SHA for 872df13

Commits on Jan 30, 2024

• Support for custom checkpointing. (#137)

  Show description for 95fdd59
  hariharan-devarajan

  authored
  95fdd59

  Copy full SHA for 95fdd59

Commits on Jan 29, 2024

• doc changes to fix DLIO profiler and remove IOStat as it needs more work. (#146)

  hariharan-devarajan

  authored
  937e6c2

  Copy full SHA for 937e6c2

• fixed printing for DLIO output. (#142)

  hariharan-devarajan

  authored
  6bd9804

  Copy full SHA for 6bd9804

• fix random sampling pytorch non-determinism. (#145)

  hariharan-devarajan

  authored
  2c3626e

  Copy full SHA for 2c3626e

Commits on Jan 26, 2024

• fix dataloader initialization to only happen once. Not on every epoch. (#143)

  hariharan-devarajan

  authored
  0827fe5

  Copy full SHA for 0827fe5

Commits on Jan 19, 2024

• Fix MPI finalization. (#139)

  Show description for fb762c2
  hariharan-devarajan

  authored
  fb762c2

  Copy full SHA for fb762c2

Commits on Jan 10, 2024

• added dlp for spawned workers pytorch (#136)

  Show description for 46f5a4e
  hariharan-devarajan

  authored
  46f5a4e

  Copy full SHA for 46f5a4e

Commits on Jan 9, 2024

• added checkpointing to support LLMs (#114)

  Show description for 0a6130a
  hariharan-devarajan

  authored
  0a6130a

  Copy full SHA for 0a6130a

Commits on Dec 7, 2023

• Added force install for profiler for avoiding caching issues (#123)

  hariharan-devarajan

  authored
  088d288

  Copy full SHA for 088d288

Commits on Dec 2, 2023

• switch dlio_profiler to use pypi instead of github (#120)

  hariharan-devarajan

  authored
  870ad84

  Copy full SHA for 870ad84

• fix Docker file to use venv. (#119)

  hariharan-devarajan

  authored
  4175343

  Copy full SHA for 4175343

Commits on Nov 20, 2023

• adding dlp logger. (#109)

  Show description for d06e63f
  

  hariharan-devarajan

  and

  zhenghh04

  authored
  d06e63f

  Copy full SHA for d06e63f

• Making DLIO Profiler default for dlio_benchmark. (#111)

  Show description for 035f512
  

  hariharan-devarajan

  and

  zhenghh04

  authored
  035f512

  Copy full SHA for 035f512

Commits on Nov 6, 2023

• Fix the data dir path (#108)

  Show description for 8dd1223
  hariharan-devarajan

  authored
  8dd1223

  Copy full SHA for 8dd1223

Commits on Oct 17, 2023

• Added Info logging for profiler and removed unnecessary bracket calls. (#104)

  hariharan-devarajan

  authored
  a724c11

  Copy full SHA for a724c11

Commits on Oct 16, 2023

• Update typo which gives issue for pytorch 1.3.1 (#103)

  Show description for 5b98fa1
  hariharan-devarajan

  authored
  5b98fa1

  Copy full SHA for 5b98fa1

Commits on Oct 4, 2023

• Fixing Dali Data loader Parallelism and Pipelining. (#93)

  Show description for b63cafc
  

  hariharan-devarajan

  and

  zhenghh04

  authored
  b63cafc

  Copy full SHA for b63cafc

Commits on Oct 3, 2023

• fixes the calculation of image idx.

  hariharan-devarajan

  committed
  93fff2c

  Copy full SHA for 93fff2c

• fixes the calculation of image idx.

  hariharan-devarajan

  committed
  29668a4

  Copy full SHA for 29668a4

• Merge branch 'main' into bugfix/dali-dl

  hariharan-devarajan

  committed
  6f0ed45

  Copy full SHA for 6f0ed45

• Merge branch 'main' into bugfix/dali-dl

  hariharan-devarajan

  committed
  8a84f55

  Copy full SHA for 8a84f55

• fixed dali data loader execution.

  hariharan-devarajan

  committed
  3c15dc3

  Copy full SHA for 3c15dc3

Pagination

Previous

Next