Commits

Breadcrumbs

History for

on0.2.11

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 30, 2024

• add non competitive gates

  lucidrains

  committed
  e96826c

  Copy full SHA for e96826c

Commits on Aug 29, 2023

• add an option for layernorming the output of product key memory

  lucidrains

  committed
  34174cb

  Copy full SHA for 34174cb

Commits on Jun 30, 2023

• offer an option to concat the values across heads (with head dimension) and then project out, like multi-head attention

  lucidrains

  committed
  ddcb10f

  Copy full SHA for ddcb10f

Commits on Jun 28, 2023

• ability to add gumble noise for stochastic sampling of memories

  lucidrains

  committed
  528b910

  Copy full SHA for 528b910

Commits on Jun 27, 2023

• note to future self

  lucidrains

  committed
  09c829a

  Copy full SHA for 09c829a

• repo is prettier with diagram

  lucidrains

  committed
  2c628eb

  Copy full SHA for 2c628eb

Commits on Jun 26, 2023

• update head dimension

  lucidrains

  committed
  80ce8d7

  Copy full SHA for 80ce8d7

Commits on Jun 25, 2023

• link

  lucidrains

  authored
  a89080c

  Copy full SHA for a89080c

• redo with einops to ready to improve upon

  lucidrains

  committed
  70f6af1

  Copy full SHA for 70f6af1

Commits on Jun 9, 2020

• remove evonorm, not working as well as batch norm

  lucidrains

  committed
  d9121d6

  Copy full SHA for d9121d6

• make pkm even more convenient

  lucidrains

  committed
  8d41d18

  Copy full SHA for 8d41d18

Commits on Jun 8, 2020

• update citation

  lucidrains

  committed
  c92b9c3

  Copy full SHA for c92b9c3

Commits on Jun 7, 2020

• make sure batch norm keeps proper statistics for variable lengthed sequences

  lucidrains

  committed
  03a96fc

  Copy full SHA for 03a96fc

• properly initialize embeddingbag and also update helper function to return the set of parameters that are not the embedding bag parameters

  lucidrains

  committed
  48e7055

  Copy full SHA for 48e7055

• separate out dimension of each head, should be at 256

  lucidrains

  committed
  c6bb046

  Copy full SHA for c6bb046

• add badge

  lucidrains

  committed
  bd62035

  Copy full SHA for bd62035

• update readme

  lucidrains

  committed
  3656ae5

  Copy full SHA for 3656ae5

• set new defaults by recommendation from @AranKomat

  lucidrains

  committed
  dc93c25

  Copy full SHA for dc93c25

• add ability to use evonorm-s0

  lucidrains

  committed
  58cb2d9

  Copy full SHA for 58cb2d9

• use embeddingbag and add batchnorm1d (but look into replacing with evonorm-s0)

  lucidrains

  committed
  915dd92

  Copy full SHA for 915dd92

Commits on Jun 6, 2020

• add helper function for fetching relevant pkm parameters for different learning rate

  lucidrains

  committed
  ef6025c

  Copy full SHA for ef6025c

• update readme

  lucidrains

  committed
  c107e93

  Copy full SHA for c107e93

• update readme

  lucidrains

  committed
  9958d44

  Copy full SHA for 9958d44

• initial commit

  lucidrains

  committed
  1027906

  Copy full SHA for 1027906

• Update README.md

  lucidrains

  authored
  312885a

  Copy full SHA for 312885a

• Update README.md

  lucidrains

  authored
  5e706f9

  Copy full SHA for 5e706f9

• Create README.md

  lucidrains

  authored
  cbdb03d

  Copy full SHA for cbdb03d

Loading