Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 4, 2024

• working version for olmo

  

  Ubuntu

  committed
  a5cc4eb

  Copy full SHA for a5cc4eb

Commits on May 31, 2024

• custom modeling_ppo and accelerate_base_trainer for falcon & mistral support. mistral performance is a bit strange, it degenerates much faster than llama 2

  

  Ubuntu

  committed
  424570a

  Copy full SHA for 424570a

Commits on Jan 8, 2024

• Update README.md (CarperAI#586)

  StellaAthena

  authored
  3340c2f

  Copy full SHA for 3340c2f

Commits on Oct 30, 2023

• fix model state_dict retrieving in zero3 (CarperAI#576)

  Show description for c26d450
  

  Jingru

  and

  聂靖入

  authored
  c26d450

  Copy full SHA for c26d450

Commits on Oct 26, 2023

• fix(modeling_base): partial loading of a sharded checkpoint (CarperAI#578)

  maxreciprocate

  authored
  91a0f43

  Copy full SHA for 91a0f43

• support customized run_name in tracker (CarperAI#573)

  Show description for 0575ce5
  

  Jingru

  and

  聂靖入

  authored
  0575ce5

  Copy full SHA for 0575ce5

Commits on Oct 23, 2023

• support extra model and tokenizer configs during loading by from_pretrained in accelerate trainer (CarperAI#568)

  Show description for bcbcdac
  

  3 peopleauthored
  bcbcdac

  Copy full SHA for bcbcdac

• docs: update documentation (CarperAI#557)

  Show description for 69b02b0
  maxreciprocate

  authored
  69b02b0

  Copy full SHA for 69b02b0

Commits on Oct 20, 2023

• fix(examples/t5_summarize_cnn): move labels into reward_fn kwargs (CarperAI#570)

  Show description for db466cb
  maxreciprocate

  authored
  db466cb

  Copy full SHA for db466cb

Commits on Oct 17, 2023

• fix(modeling_base): re-order model.forward_kwargs initialization (CarperAI#566)

  Show description for d03fea7
  maxreciprocate

  authored
  d03fea7

  Copy full SHA for d03fea7

Commits on Oct 11, 2023

• feat: add rejection finetuning trainer (CarperAI#554)

  Show description for bcd237f
  maxreciprocate

  authored
  bcd237f

  Copy full SHA for bcd237f

Commits on Sep 25, 2023

• add default llama2 config converter (CarperAI#563)

  Show description for 78c7faa
  

  PhungVanDuy

  and

  Duy Phung

  authored
  78c7faa

  Copy full SHA for 78c7faa

Commits on Sep 22, 2023

• Llama NeMo support (CarperAI#542)

  Show description for ffa5ba1
  

  4 peopleauthored
  ffa5ba1

  Copy full SHA for ffa5ba1

Commits on Sep 1, 2023

• Update README.md (CarperAI#550)

  Dahoas

  authored
  3685a75

  Copy full SHA for 3685a75

• fix(examples/hh): old gpt-j checkpoint loading (CarperAI#552)

  maxreciprocate

  authored
  bf0fe38

  Copy full SHA for bf0fe38

Commits on Aug 31, 2023

• chore(requirements.txt): update everything to the latest (CarperAI#547)

  Show description for a7eb066
  maxreciprocate

  authored
  a7eb066

  Copy full SHA for a7eb066

Commits on Aug 29, 2023

• Add DS-Chat comparison (CarperAI#538)

  Show description for dad174c
  

  cat-state

  and

  cat-state

  authored
  dad174c

  Copy full SHA for dad174c

Commits on Aug 28, 2023

• revert(ppo_trainer): keep save_pretrained only over the base model (CarperAI#551)

  Show description for 3e45789
  maxreciprocate

  authored
  3e45789

  Copy full SHA for 3e45789

Commits on Aug 21, 2023

• mpt support (CarperAI#546)

  Show description for 900040a
  

  50m-regent

  and

  50mRegent

  authored
  900040a

  Copy full SHA for 900040a

Commits on Aug 8, 2023

• fix(modeling): deepspeed checkpoint loading (CarperAI#482)

  Show description for 2e667e6
  

  maxreciprocate

  and

  jon-tow

  authored
  2e667e6

  Copy full SHA for 2e667e6

Commits on Aug 2, 2023

• Value branch (CarperAI#530)

  Show description for 67bc8ba
  Dahoas

  authored
  67bc8ba

  Copy full SHA for 67bc8ba

• Freeze "output" embedding when using tied embeddings. (CarperAI#543)

  Show description for 5735bf3
  

  cat-state

  and

  cat-state

  authored
  5735bf3

  Copy full SHA for 5735bf3

Commits on Jul 31, 2023

• fix reward model state dict loading (CarperAI#541)

  maxjeblick

  authored
  1d69f90

  Copy full SHA for 1d69f90

• Fix LLaMA example (LLaMA 2) (CarperAI#539)

  Show description for acd0a41
  

  4 peopleauthored
  acd0a41

  Copy full SHA for acd0a41

• Fix ordering of ppo epoch iteration (CarperAI#522)

  Show description for 6f7f59d
  

  RobertKirk

  and

  maxreciprocate

  authored
  6f7f59d

  Copy full SHA for 6f7f59d

Commits on Jul 24, 2023

• fix(modeling_ppo): load reference head under zero3 (CarperAI#489)

  Show description for e36fe9d
  maxreciprocate

  authored
  e36fe9d

  Copy full SHA for e36fe9d

• Fix logging (CarperAI#526)

  Show description for dbdefd8
  

  Dahoas

  and

  maxreciprocate

  authored
  dbdefd8

  Copy full SHA for dbdefd8

Commits on Jul 21, 2023

• Update README.md (CarperAI#537)

  Dahoas

  authored
  5d0f04d

  Copy full SHA for 5d0f04d

Commits on Jul 20, 2023

• Fix: rename model_tok to tokenizer is reward_fn arg (CarperAI#534)

  Dahoas

  authored
  288d4cb

  Copy full SHA for 288d4cb

Commits on Jul 19, 2023

• Dense reward carper (Fine grained feedback) (CarperAI#514)

  Show description for 0c94ee8
  

  3 peopleauthored
  0c94ee8

  Copy full SHA for 0c94ee8

Commits on Jul 17, 2023

• fix(ci): don't rely on cache in actions/setup-python (CarperAI#524)

  maxreciprocate

  authored
  ba947e5

  Copy full SHA for ba947e5

Commits on Jul 13, 2023

• feat(readme): add instructions to avoid OOMs with hyperparameters (CarperAI#470)

  Show description for 5c5abca
  maxreciprocate

  authored
  5c5abca

  Copy full SHA for 5c5abca

Commits on Jul 10, 2023

• Update README.md

  LouisCastricato

  authored
  1446523

  Copy full SHA for 1446523

Commits on Jul 5, 2023

• fix peft config cause tensorboard type error (CarperAI#515)

  congchan

  authored
  b9c16f5

  Copy full SHA for b9c16f5

• fix(modeling_base): handle parent directory for peft head save (CarperAI#516)

  congchan

  authored
  cf865fa

  Copy full SHA for cf865fa

Pagination

Previous

Next