Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 28, 2024

• Output eval logging batch (mosaicml#961)

  Show description for 7a8a156
  

  3 peopleauthored
  7a8a156

  Copy full SHA for 7a8a156

Commits on Mar 25, 2024

• Models registry (mosaicml#1057)

  dakinggg

  authored
  2d65fc2

  Copy full SHA for 2d65fc2

Commits on Mar 24, 2024

• Fix multi model eval (mosaicml#1055)

  dakinggg

  authored
  648b1bd

  Copy full SHA for 648b1bd

• Update README.md (mosaicml#1056)

  Show description for c9685cf
  dennyglee

  authored
  c9685cf

  Copy full SHA for c9685cf

Commits on Mar 23, 2024

• log details to metadata for run analytics (mosaicml#992)

  angel-ruiz7

  authored
  31e4879

  Copy full SHA for 31e4879

Commits on Mar 20, 2024

• Registry based config - Part 1 (mosaicml#975)

  dakinggg

  authored
  9bf3701

  Copy full SHA for 9bf3701

Commits on Mar 18, 2024

• Remove references to attn_impl: triton (mosaicml#1041)

  dakinggg

  authored
  c26309d

  Copy full SHA for c26309d

Commits on Mar 11, 2024

• finish (mosaicml#1022)

  Show description for 4e43792
  

  bmosaicml

  and

  maxisawesome

  authored
  4e43792

  Copy full SHA for 4e43792

• Add code import to train/eval scripts (mosaicml#1002)

  dakinggg

  authored
  d61c53d

  Copy full SHA for d61c53d

Commits on Mar 1, 2024

• Make CodeEval respect device_eval_batch_size (mosaicml#956)

  josejg

  authored
  d104d16

  Copy full SHA for d104d16

Commits on Feb 14, 2024

• Fix fewshot_random_seed default setting (mosaicml#974)

  Show description for 73033ee
  maxisawesome

  authored
  73033ee

  Copy full SHA for 73033ee

Commits on Feb 12, 2024

• Add new ICL kwargs in eval.py and long_context yamls (mosaicml#925)

  Show description for e88cdf1
  

  maxisawesome

  and

  dakinggg

  authored
  e88cdf1

  Copy full SHA for e88cdf1

Commits on Feb 9, 2024

• Fix eval.py with lora (mosaicml#965)

  Show description for 12d1ca7
  dakinggg

  authored
  12d1ca7

  Copy full SHA for 12d1ca7

Commits on Feb 6, 2024

• Fix chain-of-thought tasks (mosaicml#824)

  Show description for 6591f48
  

  3 peopleauthored
  6591f48

  Copy full SHA for 6591f48

• Bump llm-foundry version to 0.5.0 (mosaicml#948)

  Show description for a667ebf
  irenedea

  authored
  a667ebf

  Copy full SHA for a667ebf

Commits on Feb 3, 2024

• Refactoring the function to accept list of metric names instead of a dictionary of metrics. (mosaicml#938)

  Show description for 706ea7d
  ShashankMosaicML

  authored
  706ea7d

  Copy full SHA for 706ea7d

Commits on Feb 1, 2024

• Add rich formatting to tracebacks (mosaicml#927)

  Show description for b928de8
  jjanezhang

  authored
  b928de8

  Copy full SHA for b928de8

Commits on Jan 31, 2024

• Fixes yaml linting (mosaicml#920)

  b-chu

  authored
  7dc51e9

  Copy full SHA for 7dc51e9

Commits on Jan 27, 2024

• Add support for eval_loader & eval_subset_num_batches in async callback (mosaicml#834)

  Show description for bdcce63
  

  aspfohl

  and

  dakinggg

  authored
  bdcce63

  Copy full SHA for bdcce63

Commits on Jan 26, 2024

• Add flag to enable/disable param upload (mosaicml#912)

  Show description for 534f5b4
  

  ngcgarcia

  and

  dakinggg

  authored
  534f5b4

  Copy full SHA for 534f5b4

Commits on Dec 19, 2023

• Async eval callback (mosaicml#702)

  Show description for a7e916b
  

  3 peopleauthored
  a7e916b

  Copy full SHA for a7e916b

• Expand options for MMLU. (mosaicml#811)

  Show description for dc77451
  mansheej

  authored
  dc77451

  Copy full SHA for dc77451

Commits on Dec 15, 2023

• Clean up the logs, bump datasets and transformers (mosaicml#804)

  dakinggg

  authored
  06b9a1f

  Copy full SHA for 06b9a1f

Commits on Dec 14, 2023

• update openai wrapper to work with tiktoken interface and newest openai version (mosaicml#794)

  Show description for 5cc4dd4
  

  3 peopleauthored
  5cc4dd4

  Copy full SHA for 5cc4dd4

Commits on Dec 9, 2023

• Update gauntlet v0.2 to reflect results of calibration (mosaicml#791)

  Show description for 8d96f9d
  bmosaicml

  authored
  8d96f9d

  Copy full SHA for 8d96f9d

Commits on Dec 4, 2023

• fix siqa (mosaicml#774)

  bmosaicml

  authored
  61cd110

  Copy full SHA for 61cd110

Commits on Nov 30, 2023

• Add eval loader to eval script (mosaicml#742)

  Show description for 3100859
  aspfohl

  authored
  3100859

  Copy full SHA for 3100859

Commits on Nov 21, 2023

• Gauntlet v0.1.0 yaml fixes (mosaicml#748)

  Show description for e7943e3
  

  3 peopleauthored
  e7943e3

  Copy full SHA for e7943e3

Commits on Nov 20, 2023

• Remove extra test suite (mosaicml#743)

  dakinggg

  authored
  437fc55

  Copy full SHA for 437fc55

• Gauntlet v0.1 (mosaicml#674)

  Show description for ab5577b
  

  3 peopleauthored
  ab5577b

  Copy full SHA for ab5577b

Commits on Nov 6, 2023

• Remove HumanEval tasks from ICL eval (mosaicml#715)

  Show description for be467ae
  tbarton16

  authored
  be467ae

  Copy full SHA for be467ae

Commits on Oct 27, 2023

• Change gauntlet avging (mosaicml#640)

  Show description for 9027f49
  

  bmosaicml

  and

  dakinggg

  authored
  9027f49

  Copy full SHA for 9027f49

Commits on Oct 12, 2023

• small typos in eval readme (mosaicml#671)

  maxisawesome

  authored
  aecadc9

  Copy full SHA for aecadc9

Commits on Oct 11, 2023

• Adding Simplified Coding Tasks (mosaicml#645)

  Show description for cdb1c28
  

  3 peopleauthored
  cdb1c28

  Copy full SHA for cdb1c28

Commits on Oct 10, 2023

• chang bsz to 1 (mosaicml#654)

  Show description for 1bf0a93
  

  bmosaicml

  and

  dakinggg

  authored
  1bf0a93

  Copy full SHA for 1bf0a93

Pagination

Previous

Next