Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 28, 2021

• Merge pull request EleutherAI#230 from nostalgebraist/tfrecords-prepend-fix

  Show description for d741ddf
  StellaAthena

  authored
  d741ddf

  Copy full SHA for d741ddf

Commits on Aug 10, 2021

• fixes "IndexError: list index out of range"

  Show description for d91cb2a
  mgrankin

  authored
  d91cb2a

  Copy full SHA for d91cb2a

Commits on Jun 26, 2021

• ensure prefix resets every iteration

  nostalgebraist

  committed
  b12f6b2

  Copy full SHA for b12f6b2

• fix prepend weirdness

  nostalgebraist

  committed
  d10344e

  Copy full SHA for d10344e

Commits on Jun 9, 2021

• [Data] create tfrecords: fail fast when no files are found

  louis030195

  committed
  331070c

  Copy full SHA for 331070c

Commits on Mar 22, 2021

• update notebook

  

  sid

  committed
  947fb9b

  Copy full SHA for 947fb9b

Commits on Mar 21, 2021

• cleanup + add pretrained models

  

  sid

  committed
  67c4079

  Copy full SHA for 67c4079

Commits on Dec 17, 2020

• change no_ftfy arg to ftfy

  Show description for 2793a7e
  sdtblck

  authored
  2793a7e

  Copy full SHA for 2793a7e

Commits on Dec 13, 2020

• add ftfy back in and remove unused args

  sdtblck

  authored
  ff1e3fb

  Copy full SHA for ff1e3fb

• Fix more things

  leogao2

  authored
  220b557

  Copy full SHA for 220b557

Commits on Dec 12, 2020

• Change default separator from 0 to 50256

  leogao2

  authored
  247e385

  Copy full SHA for 247e385

• Make files_per default to 100k

  leogao2

  authored
  f2e0104

  Copy full SHA for f2e0104

• Remove --use_gpt2_tokenizer

  Show description for 7d7871d
  leogao2

  authored
  7d7871d

  Copy full SHA for 7d7871d

• Remove --log_dir

  Show description for 57517d5
  leogao2

  authored
  57517d5

  Copy full SHA for 57517d5

Commits on Dec 10, 2020

• remove chunk size warning

  

  sid

  committed
  ed87725

  Copy full SHA for ed87725

• change default chunk size to equal context size

  

  sid

  committed
  225d983

  Copy full SHA for 225d983

Commits on Dec 8, 2020

• Added dropped )

  StellaAthena

  authored
  2004652

  Copy full SHA for 2004652

• Added clarifying comment

  StellaAthena

  authored
  22fb917

  Copy full SHA for 22fb917

• make input_fn a param and add deprecation warning to old input_fn

  ConnorJL

  committed
  860b35c

  Copy full SHA for 860b35c

• refactor inputs and create_tfrecords

  ConnorJL

  committed
  fd28d0f

  Copy full SHA for fd28d0f

• Revert "fix inputs"

  Show description for 738e970
  ConnorJL

  committed
  738e970

  Copy full SHA for 738e970

• fix inputs

  ConnorJL

  committed
  ffd72bc

  Copy full SHA for ffd72bc

• add sequential_input fn and new create_tfrecords script

  ConnorJL

  committed
  8b877fa

  Copy full SHA for 8b877fa

Commits on Nov 29, 2020

• fix empty files being written to tfrecords

  

  sid

  committed
  5edc227

  Copy full SHA for 5edc227

Commits on Nov 21, 2020

• add wikitext eval

  ConnorJL

  committed
  a2b731b

  Copy full SHA for a2b731b

Commits on Nov 13, 2020

• Disable threading for lmd (again)

  leogao2

  authored
  9793100

  Copy full SHA for 9793100

• Disable threading in lmd

  Show description for 26aef0a
  leogao2

  authored
  26aef0a

  Copy full SHA for 26aef0a

Commits on Nov 1, 2020

• code cleanup, update configs

  

  sid

  committed
  710c0d9

  Copy full SHA for 710c0d9

• move create_tfrecords.py and train_tokenizer.py into ./data

  

  sid

  committed
  951c531

  Copy full SHA for 951c531

Loading