Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 12, 2024

• fix setup.py

  lucidrains

  committed
  66227df

  Copy full SHA for 66227df

• address #25

  lucidrains

  committed
  8276e18

  Copy full SHA for 8276e18

Commits on Nov 23, 2021

• fix torch.flip not liking bool type

  lucidrains

  committed
  8afd75c

  Copy full SHA for 8afd75c

Commits on Sep 26, 2021

• make sure mask is passed

  lucidrains

  committed
  4e7f4fc

  Copy full SHA for 4e7f4fc

Commits on Aug 21, 2021

• fix potential bug of coarsening one extra level than needed

  lucidrains

  committed
  acd22d7

  Copy full SHA for acd22d7

Commits on Aug 20, 2021

• readme

  lucidrains

  authored
  110cab0

  Copy full SHA for 110cab0

Commits on Aug 15, 2021

• add token shifting experimental research feature, to improve on baseline

  lucidrains

  committed
  90dd204

  Copy full SHA for 90dd204

Commits on Aug 11, 2021

• readme

  lucidrains

  authored
  731e0d1

  Copy full SHA for 731e0d1

• add colab link

  lucidrains

  committed
  94cc067

  Copy full SHA for 94cc067

Commits on Aug 10, 2021

• add reversible networks, to allow for scaling depth

  lucidrains

  committed
  a8d9c4b

  Copy full SHA for a8d9c4b

• fix an off by one

  lucidrains

  committed
  9c09a00

  Copy full SHA for 9c09a00

Commits on Aug 8, 2021

• use .max.values to be compatible with older version of pytorch

  lucidrains

  committed
  7c11d03

  Copy full SHA for 7c11d03

• fix eos token for batched case

  lucidrains

  committed
  e3cb1af

  Copy full SHA for e3cb1af

• fix positional embedding for sequence lengths that are not powers of two of causal case

  lucidrains

  committed
  4e94794

  Copy full SHA for 4e94794

• fix mask

  lucidrains

  committed
  826eb98

  Copy full SHA for 826eb98

• use padded length for rotary embeddings

  lucidrains

  committed
  25f9a13

  Copy full SHA for 25f9a13

Commits on Aug 6, 2021

• switch to rotary embeddings

  lucidrains

  committed
  dcc49b7

  Copy full SHA for dcc49b7

• readme

  lucidrains

  committed
  ae652a9

  Copy full SHA for ae652a9

• bump

  lucidrains

  committed
  89cb623

  Copy full SHA for 89cb623

• make autoregressive h-transformer-1d work

  lucidrains

  committed
  381073c

  Copy full SHA for 381073c

Commits on Aug 5, 2021

• fix some bugs

  lucidrains

  committed
  5660abd

  Copy full SHA for 5660abd

Commits on Jul 29, 2021

• last bug

  lucidrains

  committed
  63063d5

  Copy full SHA for 63063d5

• fix bug with mask

  lucidrains

  committed
  5385d15

  Copy full SHA for 5385d15

• make example more dramatic

  lucidrains

  committed
  0ef6e1b

  Copy full SHA for 0ef6e1b

• take care of padding to power of 2 sequence length

  lucidrains

  committed
  3d0dc0e

  Copy full SHA for 3d0dc0e

• release h-transformers-1d for non-causal case only

  lucidrains

  committed
  d778f10

  Copy full SHA for d778f10

• fix leakage problem with stable softmax

  lucidrains

  committed
  629723d

  Copy full SHA for 629723d

• use stable softmax

  lucidrains

  committed
  0b0788a

  Copy full SHA for 0b0788a

• fix potential bug

  lucidrains

  committed
  b5bb4f8

  Copy full SHA for b5bb4f8

• wip

  lucidrains

  committed
  ef34b82

  Copy full SHA for ef34b82

• masking for causal, as well as removing right off diagonal blocks

  lucidrains

  committed
  9304714

  Copy full SHA for 9304714

Commits on Jul 28, 2021

• absolute positional embedding for now

  lucidrains

  committed
  6ca9077

  Copy full SHA for 6ca9077

• account for causal for top-level tokens

  lucidrains

  committed
  227b87b

  Copy full SHA for 227b87b

• first pass at algorithm

  lucidrains

  committed
  c1f04c4

  Copy full SHA for c1f04c4

• enwik

  lucidrains

  committed
  87e3107

  Copy full SHA for 87e3107

Pagination

Previous

Next