Commits

Branch selector

 main

User selector

vchiley

Datepicker

All time

Commit History

Commits on Jan 23, 2024

• Enable QK Group Norm (mosaicml#869)

  Show description for ea0521c
  vchiley

  authored
  ea0521c

  Copy full SHA for ea0521c

Commits on Jan 18, 2024

• fsdp wrap refac (mosaicml#883)

  Show description for 19ee086
  vchiley

  authored
  19ee086

  Copy full SHA for 19ee086

Commits on Jan 1, 2024

• Align GLU implementation with LLaMa (mosaicml#829)

  Show description for 1ac5c4b
  vchiley

  authored
  1ac5c4b

  Copy full SHA for 1ac5c4b

Commits on Dec 15, 2023

• Make the ffn activation func configurable (mosaicml#805)

  Show description for 15e79f3
  vchiley

  authored
  15e79f3

  Copy full SHA for 15e79f3

Commits on Dec 13, 2023

• clean up resolve_ffn_hidden_and_exp_ratio (mosaicml#801)

  Show description for 5fdcc43
  vchiley

  authored
  5fdcc43

  Copy full SHA for 5fdcc43

• Enable GLU FFN type (mosaicml#796)

  Show description for 0797aa6
  

  vchiley

  and

  dakinggg

  authored
  0797aa6

  Copy full SHA for 0797aa6

Commits on Nov 29, 2023

• enable param group configuration in llm-foundry (mosaicml#760)

  Show description for 5f21855
  

  vchiley

  and

  dakinggg

  authored
  5f21855

  Copy full SHA for 5f21855

Commits on Nov 13, 2023

• Enable tie_word_embeddings config setting to enable / disable weight tied embeddings (mosaicml#728)

  Show description for 7899178
  

  vchiley

  and

  sashaDoubov

  authored
  7899178

  Copy full SHA for 7899178

Commits on Aug 2, 2023

• fix no bias assignment (mosaicml#502)

  vchiley

  authored
  b4e27c0

  Copy full SHA for b4e27c0

Commits on Jul 17, 2023

• Add linear layer and ffn config to enable TransformerEngine layers (with FP8) (mosaicml#432)

  Show description for 340a566
  vchiley

  authored
  340a566

  Copy full SHA for 340a566

Commits on Jul 12, 2023

• Update mcli-hf-generate.yaml (mosaicml#456)

  Show description for 2f49eb7
  vchiley

  authored
  2f49eb7

  Copy full SHA for 2f49eb7

Commits on Jul 4, 2023

• Release/v0.2.0 (mosaicml#410)

  Show description for 5b316c3
  

  vchiley

  and

  mvpatel2000

  authored
  5b316c3

  Copy full SHA for 5b316c3

Commits on Jul 3, 2023

• rm peft from pypi package since it wont install (mosaicml#420)

  vchiley

  authored
  904a321

  Copy full SHA for 904a321

• Edit tutorial comments on PEFT / LoRA (mosaicml#416)

  Show description for 4e6a878
  vchiley

  authored
  4e6a878

  Copy full SHA for 4e6a878

Commits on Jul 1, 2023

• updt dtype of causal mask (mosaicml#408)

  vchiley

  authored
  37bf6f5

  Copy full SHA for 37bf6f5

• add install for AMD beta support (mosaicml#407)

  Show description for 2e852db
  

  vchiley

  and

  abhi-mosaic

  authored
  2e852db

  Copy full SHA for 2e852db

Commits on Jun 29, 2023

• propogate cache_limit in streaming ds (mosaicml#402)

  vchiley

  authored
  73783b9

  Copy full SHA for 73783b9

• add fn to clear tests after every test (mosaicml#400)

  Show description for 7ac58e0
  vchiley

  authored
  7ac58e0

  Copy full SHA for 7ac58e0

• make peft installs a extra_dep (mosaicml#397)

  Show description for 156fcf1
  

  vchiley

  and

  samhavens

  authored
  156fcf1

  Copy full SHA for 156fcf1

• updt qs eval task (mosaicml#395)

  vchiley

  authored
  9d8202b

  Copy full SHA for 9d8202b

• updt install instructions (mosaicml#396)

  vchiley

  authored
  e62dc1c

  Copy full SHA for e62dc1c

Commits on Jun 28, 2023

• updt onnx (mosaicml#385)

  vchiley

  authored
  9235e38

  Copy full SHA for 9235e38

Commits on Jun 27, 2023

• Adds max seq len filter before finetuning ds (mosaicml#359)

  Show description for 90795f3
  

  3 peopleauthored
  90795f3

  Copy full SHA for 90795f3

Commits on Jun 21, 2023

• updt yml (mosaicml#349)

  vchiley

  authored
  da7fa6b

  Copy full SHA for da7fa6b

• updt composer to 0.15.0 (mosaicml#347)

  Show description for 55da325
  

  vchiley

  and

  bmosaicml

  authored
  55da325

  Copy full SHA for 55da325

Commits on Jun 15, 2023

• Attn amp (mosaicml#337)

  Show description for 8c3c0c6
  vchiley

  authored
  8c3c0c6

  Copy full SHA for 8c3c0c6

Commits on Jun 14, 2023

• hard set bias(alibi) precision (mosaicml#329)

  Show description for 688cc52
  

  vchiley

  and

  abhi-mosaic

  authored
  688cc52

  Copy full SHA for 688cc52

Commits on May 31, 2023

• updt tritonpremlir to sm90 version (mosaicml#260)

  Show description for 9c941b0
  vchiley

  authored
  9c941b0

  Copy full SHA for 9c941b0

Commits on May 26, 2023

• Kv cache speed (mosaicml#210)

  Show description for 1ad53be
  vchiley

  authored
  1ad53be

  Copy full SHA for 1ad53be

Commits on May 24, 2023

• torch2 updt with hf fixes (mosaicml#193)

  Show description for 4c94c20
  

  vchiley

  and

  dakinggg

  authored
  4c94c20

  Copy full SHA for 4c94c20

Commits on May 19, 2023

• Torch2 (mosaicml#177) (mosaicml#178)

  Show description for bb7f8bb
  vchiley

  authored
  bb7f8bb

  Copy full SHA for bb7f8bb

Commits on May 11, 2023

• hf dict cfg overrides (mosaicml#90)

  Show description for 73ff8a0
  vchiley

  authored
  73ff8a0

  Copy full SHA for 73ff8a0

Commits on May 9, 2023

• Bump composer version (mosaicml#84)

  vchiley

  authored
  6035041

  Copy full SHA for 6035041

Commits on May 5, 2023

• Adding loss to MPTForCausalLM fwd if labels arg is not None (mosaicml#47)

  Show description for 3e16277
  

  vchiley

  and

  dakinggg

  authored
  3e16277

  Copy full SHA for 3e16277

Commits on May 4, 2023

• update readme and updt __init__ (mosaicml#46)

  Show description for 15801ca
  

  vchiley

  and

  growlix

  authored
  15801ca

  Copy full SHA for 15801ca

Pagination

Previous

Next