Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 19, 2024

• add main and optional sections

  rasbt

  committed
  283397a

  Copy full SHA for 283397a

• fixed num_workers (rasbt#229)

  Show description for bbb2a0c
  d-kleine

  authored
  bbb2a0c

  Copy full SHA for bbb2a0c

Commits on Jun 12, 2024

• fixes for code (rasbt#206)

  Show description for dcbdc1d
  

  d-kleine

  and

  rasbt

  authored
  dcbdc1d

  Copy full SHA for dcbdc1d

Commits on Jun 9, 2024

• add allowed_special={"<|endoftext|>"}

  rasbt

  committed
  39c4a88

  Copy full SHA for 39c4a88

Commits on Jun 8, 2024

• Remove leftover instances of self.tokenizer (rasbt#201)

  Show description for 72a073b
  rasbt

  authored
  72a073b

  Copy full SHA for 72a073b

Commits on May 24, 2024

• update formatting

  rasbt

  committed
  98d453b

  Copy full SHA for 98d453b

• flops analysis

  rasbt

  committed
  e5e6aaf

  Copy full SHA for e5e6aaf

Commits on May 2, 2024

• fix swiglu acronym

  rasbt

  committed
  c735c21

  Copy full SHA for c735c21

Commits on Apr 28, 2024

• Rename drop_resid to drop_shortcut (rasbt#136)

  rasbt

  authored
  97ed381

  Copy full SHA for 97ed381

Commits on Apr 20, 2024

• update figures

  rasbt

  committed
  d202cab

  Copy full SHA for d202cab

Commits on Apr 13, 2024

• Make datesets and loaders compatible with multiprocessing (rasbt#118)

  rasbt

  authored
  dd51d4a

  Copy full SHA for dd51d4a

Commits on Apr 11, 2024

• Use instance tokenizer (rasbt#116)

  Show description for 05718c6
  

  jameslholcombe

  and

  rasbt

  authored
  05718c6

  Copy full SHA for 05718c6

Commits on Apr 4, 2024

• cleanup

  rasbt

  committed
  6de0417

  Copy full SHA for 6de0417

• Rename variable to context_length to make it easier on readers (rasbt#106)

  Show description for 2de60d1
  rasbt

  authored
  2de60d1

  Copy full SHA for 2de60d1

• Remove reundant dropout in MLP module (rasbt#105)

  rasbt

  authored
  3829ccd

  Copy full SHA for 3829ccd

Commits on Mar 19, 2024

• Ch05 supplementary code (rasbt#81)

  rasbt

  authored
  a2cd843

  Copy full SHA for a2cd843

Commits on Mar 18, 2024

• Set up basic test gh worklows (rasbt#79)

  Show description for ca96aba
  rasbt

  authored
  ca96aba

  Copy full SHA for ca96aba

• Update pep8 (rasbt#78)

  Show description for 9d6da22
  rasbt

  authored
  9d6da22

  Copy full SHA for 9d6da22

Commits on Mar 17, 2024

• add notes

  rasbt

  committed
  4fc6de7

  Copy full SHA for 4fc6de7

• add more notes and embed figures externally to save space

  rasbt

  committed
  d60da19

  Copy full SHA for d60da19

Commits on Mar 16, 2024

• add imports and version on top

  rasbt

  committed
  861c296

  Copy full SHA for 861c296

Commits on Mar 10, 2024

• Remove duplicate cells

  joel-foo

  committed
  dbb5e65

  Copy full SHA for dbb5e65

Commits on Mar 9, 2024

• remove redundant unsqueeze in mask

  rasbt

  committed
  da33ce8

  Copy full SHA for da33ce8

Commits on Mar 6, 2024

• mha variants

  rasbt

  committed
  87fcfd9

  Copy full SHA for 87fcfd9

Commits on Mar 4, 2024

• add dropout for embedding layers

  rasbt

  committed
  e0df4df

  Copy full SHA for e0df4df

Commits on Mar 1, 2024

• Merge pull request rasbt#33 from rayedbw/patch-1

  Show description for c9dccb0
  rasbt

  authored
  c9dccb0

  Copy full SHA for c9dccb0

• remove redundant import

  rasbt

  committed
  267e33c

  Copy full SHA for 267e33c

Commits on Feb 29, 2024

• remove redundant double-unsequeeze

  rasbt

  committed
  b827bf4

  Copy full SHA for b827bf4

Commits on Feb 27, 2024

• Update ch04.ipynb

  Show description for 2fb0354
  rayed-therap

  authored
  2fb0354

  Copy full SHA for 2fb0354

• improve code comments

  rasbt

  committed
  f6266c3

  Copy full SHA for f6266c3

Commits on Feb 25, 2024

• use .shape instead of .size() for consistency

  rasbt

  committed
  3f186ab

  Copy full SHA for 3f186ab

• drop_last=True

  rasbt

  committed
  cdcd73b

  Copy full SHA for cdcd73b

Commits on Feb 24, 2024

• rename to dataloader v1

  rasbt

  committed
  6243726

  Copy full SHA for 6243726

• comment update

  rasbt

  committed
  4e68649

  Copy full SHA for 4e68649

Commits on Feb 16, 2024

• use smaller number of tokens to emphasize next token prediction goal

  rasbt

  committed
  f057156

  Copy full SHA for f057156

Pagination

Previous

Next