Commits

Branch selector

 develop

User selector

ZHUI

Datepicker

All time

Commit History

Commits on Oct 14, 2021

• Add training benchmark for gpt / gpt-3. (PaddlePaddle#1091)

  ZHUI

  authored
  1b4821b

  Copy full SHA for 1b4821b

Commits on Sep 17, 2021

• Fix gpt accuracy ci tests. (PaddlePaddle#1044)

  Show description for da5a62b
  ZHUI

  authored
  da5a62b

  Copy full SHA for da5a62b

• Add additional log for training with amp. (PaddlePaddle#1042)

  ZHUI

  authored
  d1699cd

  Copy full SHA for d1699cd

Commits on Sep 14, 2021

• opt electra training for amp. (PaddlePaddle#1018)

  Show description for a827235
  

  ZHUI

  and

  ZeyuChen

  authored
  a827235

  Copy full SHA for a827235

• fix export and infer model of gpt. (PaddlePaddle#1019)

  ZHUI

  authored
  45967dc

  Copy full SHA for 45967dc

Commits on Sep 13, 2021

• Adopt new data pipeline for GPT. (PaddlePaddle#930)

  ZHUI

  authored
  1914c8a

  Copy full SHA for 1914c8a

Commits on Sep 9, 2021

• quick fix for gpt export_model (PaddlePaddle#1001)

  ZHUI

  authored
  b55782c

  Copy full SHA for b55782c

• fix deadlink (PaddlePaddle#993)

  ZHUI

  authored
  2ea5ffc

  Copy full SHA for 2ea5ffc

Commits on Sep 8, 2021

• Delete custom op for adamw. (PaddlePaddle#984)

  ZHUI

  authored
  7a4f830

  Copy full SHA for 7a4f830

• mv ernie to experimental. (PaddlePaddle#985)

  ZHUI

  authored
  4756db5

  Copy full SHA for 4756db5

• Fix bug on windows, default convert labels to int64. (PaddlePaddle#982)

  ZHUI

  authored
  41e1427

  Copy full SHA for 41e1427

Commits on Sep 2, 2021

• Ernie pretraining optimization (PaddlePaddle#956)

  Show description for a96ebb0
  

  ZHUI

  and

  ZeyuChen

  authored
  a96ebb0

  Copy full SHA for a96ebb0

Commits on Aug 30, 2021

• fix gpt tokenizer typo (PaddlePaddle#935)

  ZHUI

  authored
  94c641a

  Copy full SHA for 94c641a

• Fix serious bug of batch sampler. (PaddlePaddle#939)

  ZHUI

  authored
  7789a64

  Copy full SHA for 7789a64

Commits on Aug 26, 2021

• Add new pretraining data process for transformers pretrain and ernie-1.0 pretrain example. (PaddlePaddle#816)

  ZHUI

  authored
  1a7cfc7

  Copy full SHA for 1a7cfc7

Commits on Aug 6, 2021

• Add huggingface gpt converter. (PaddlePaddle#859)

  Show description for eee6be9
  ZHUI

  authored
  eee6be9

  Copy full SHA for eee6be9

Commits on Aug 4, 2021

• Update GPT-3 Readme. (PaddlePaddle#843)

  ZHUI

  authored
  02998ad

  Copy full SHA for 02998ad

Commits on Aug 2, 2021

• GPT, spilt modeling to gpt-3 for training (PaddlePaddle#710)

  Show description for 84257cd
  ZHUI

  authored
  84257cd

  Copy full SHA for 84257cd

Commits on Jul 27, 2021

• simplify requirements.txt (PaddlePaddle#808)

  Show description for 4e56ba5
  

  ZHUI

  and

  ZeyuChen

  authored
  4e56ba5

  Copy full SHA for 4e56ba5

Commits on Jul 7, 2021

• GPT. refine args print. (PaddlePaddle#701)

  ZHUI

  authored
  7c76b2f

  Copy full SHA for 7c76b2f

Commits on Jul 6, 2021

• GPT. use ClipGradByGlobalNorm, update unittest (PaddlePaddle#693)

  ZHUI

  authored
  58db4d0

  Copy full SHA for 58db4d0

Commits on Jul 1, 2021

• bug fix on windows, default convert to int64. (PaddlePaddle#676)

  ZHUI

  authored
  a489bd8

  Copy full SHA for a489bd8

Commits on Jun 30, 2021

• [GPT] Add MP enhancement and accuracy check scripts. (PaddlePaddle#624)

  Show description for aa596fb
  

  ZHUI

  and

  wangxicoding

  authored
  aa596fb

  Copy full SHA for aa596fb

Commits on Jun 18, 2021

• [GPT]. Optimize the speed of static graph, fix num_heads, add gpt2-small-en for CE. (PaddlePaddle#588)

  ZHUI

  authored
  4653834

  Copy full SHA for 4653834

Commits on Jun 16, 2021

• using new api cross_entropy. (PaddlePaddle#573)

  ZHUI

  authored
  840149d

  Copy full SHA for 840149d

Commits on Jun 11, 2021

• [GPT] small bug fix. (PaddlePaddle#545)

  Show description for fc3cf74
  ZHUI

  authored
  fc3cf74

  Copy full SHA for fc3cf74

Commits on Jun 7, 2021

• Small bug fix for GPT (PaddlePaddle#509)

  ZHUI

  authored
  500c8a2

  Copy full SHA for 500c8a2

Commits on Jun 4, 2021

• Fix GPT modle error link. (PaddlePaddle#487)

  ZHUI

  authored
  decf736

  Copy full SHA for decf736

Commits on May 27, 2021

• Merge branch 'develop' into gpt/mp_fix

  ZHUI

  authored
  d16c983

  Copy full SHA for d16c983

Commits on May 26, 2021

• GPT: add ips.

  ZHUI

  committed
  82652b7

  Copy full SHA for 82652b7

• GPT: fix dropout.

  ZHUI

  committed
  7fac24a

  Copy full SHA for 7fac24a

Commits on May 24, 2021

• GPT use DistributedBatchSampler to broardcast data.

  ZHUI

  committed
  054ae13

  Copy full SHA for 054ae13

• Tensor Parallelism, fix as paddle #33015 .

  ZHUI

  committed
  5c5268c

  Copy full SHA for 5c5268c

Commits on May 20, 2021

• fix deadlink (PaddlePaddle#423)

  ZHUI

  authored
  3ae072a

  Copy full SHA for 3ae072a

Commits on May 19, 2021

• GPT: fix batch predict. (PaddlePaddle#411)

  ZHUI

  authored
  f2dbd81

  Copy full SHA for f2dbd81

Pagination

Previous

Next