Commits

Branch selector

 master

User selector

syzymon

Datepicker

All time

Commit History

Commits on Oct 20, 2021

• Merge of PR google#1706

  Show description for b02b938
  

  syzymon

  authored and

  copybara-github

  committed
  b02b938

  Copy full SHA for b02b938

Commits on Oct 19, 2021

• Merge of PR google#1699

  Show description for 9dbe4be
  

  syzymon

  authored and

  copybara-github

  committed
  9dbe4be

  Copy full SHA for 9dbe4be

Commits on Oct 6, 2021

• Update gin config for enwik8

  syzymon

  committed
  be613ba

  Copy full SHA for be613ba

Commits on Sep 16, 2021

• Make PrintShape work correctly when there is only one input

  syzymon

  committed
  5f7a27e

  Copy full SHA for 5f7a27e

• Fix duplication bug in generate_sequential_chunks when example is shorter than max_length

  syzymon

  committed
  2e1f6db

  Copy full SHA for 2e1f6db

• Update gin files for Hourglass

  syzymon

  committed
  3d2b954

  Copy full SHA for 3d2b954

• Add Hourglass

  syzymon

  committed
  1fb8dc3

  Copy full SHA for 1fb8dc3

Commits on Aug 21, 2021

• Rotary embeddings

  syzymon

  committed
  6a41b7c

  Copy full SHA for 6a41b7c

Commits on Aug 20, 2021

• Adjust number of funnel blocks in enwik experiment

  syzymon

  committed
  477f20a

  Copy full SHA for 477f20a

• Update imagenet32/64 parameters

  syzymon

  committed
  42d5017

  Copy full SHA for 42d5017

Commits on Aug 19, 2021

• Add wiki40b experiment

  syzymon

  committed
  68f647e

  Copy full SHA for 68f647e

• Fix max_len in the cifar10 Transformer config

  syzymon

  committed
  f6e5e87

  Copy full SHA for f6e5e87

Commits on Aug 18, 2021

• Increase number of layers in cifar10 experiment

  syzymon

  committed
  e129bfe

  Copy full SHA for e129bfe

Commits on Aug 17, 2021

• Add an option to disable residual upsampling

  syzymon

  committed
  520f32f

  Copy full SHA for 520f32f

Commits on Aug 15, 2021

• Disable predict tests

  syzymon

  committed
  2096a41

  Copy full SHA for 2096a41

• Use rotary positional embeddings in relformer_imagenet64.gin config

  syzymon

  committed
  753d73f

  Copy full SHA for 753d73f

• Gin configs for enwik8 and imagenet

  Show description for 1932326
  syzymon

  committed
  1932326

  Copy full SHA for 1932326

• Add current version of RelformerLM

  Show description for 60127d0
  syzymon

  committed
  60127d0

  Copy full SHA for 60127d0

Commits on Apr 19, 2021

• Update relformer_imagenet64.gin and add sweep (google#33)

  syzymon

  committed
  dd4e248

  Copy full SHA for dd4e248

Commits on Mar 19, 2021

• Use SelfAttention in relformer_imagenet64.gin (google#28)

  Show description for 7620b4b
  syzymon

  authored
  7620b4b

  Copy full SHA for 7620b4b

Commits on Mar 11, 2021

• Add experimental version of RelformerLM (google#24)

  Show description for 637afd5
  syzymon

  authored
  637afd5

  Copy full SHA for 637afd5

Commits on Mar 2, 2021

• Add a note about 'predict' mode (google#23)

  Show description for db1bd4a
  syzymon

  authored
  db1bd4a

  Copy full SHA for db1bd4a

Commits on Mar 1, 2021

• Add comment about imagenet32 (google#22)

  syzymon

  authored
  24067d7

  Copy full SHA for 24067d7

Commits on Feb 15, 2021

• Remove synthetic tasks (google#21)

  syzymon

  authored
  a8fcc15

  Copy full SHA for a8fcc15

Commits on Feb 14, 2021

• Add autoregressive property (future leakage) unit test (google#19)

  syzymon

  authored
  1cf1129

  Copy full SHA for 1cf1129

Commits on Feb 13, 2021

• Change resampler_fn interface in _FunnelRelativeDecoderBlock (google#17)

  syzymon

  authored
  974f4ee

  Copy full SHA for 974f4ee

Commits on Feb 9, 2021

• Update with more current training params (google#16)

  syzymon

  authored
  8e09e4d

  Copy full SHA for 8e09e4d

Commits on Feb 5, 2021

• Fix batch size (google#15)

  syzymon

  authored
  78a33db

  Copy full SHA for 78a33db

Commits on Jan 28, 2021

• Lm funnel upsampling final merge (google#13)

  Show description for 8db8ea1
  

  5 peoplecommitted
  8db8ea1

  Copy full SHA for 8db8ea1

Commits on Nov 11, 2020

• Review fixes 2 (google#8)

  Show description for 3b8c28b
  syzymon

  authored
  3b8c28b

  Copy full SHA for 3b8c28b

Commits on Nov 8, 2020

• Review fixes (google#7)

  Show description for 7aa3e84
  syzymon

  authored
  7aa3e84

  Copy full SHA for 7aa3e84

Commits on Oct 28, 2020

• Add customizable pooling layer + implement alternative funnel block + basic unit tests (google#2)

  

  syzymon

  authored and

  mtyrolski

  committed
  73a64f7

  Copy full SHA for 73a64f7