Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 29, 2024

• [Major] Support Llama3 and update on-the-fly rope scaling (mit-han-lab#177)

  kentang-mit

  authored
  b76fab6

  Copy full SHA for b76fab6

Commits on Feb 26, 2024

• Fix memory issue when running run_awq

  isaac-vidas

  authored
  ef2ce1d

  Copy full SHA for ef2ce1d

Commits on Feb 23, 2024

• [MAJOR] add new backend kernels & support multi-modal models

  ys-2020

  committed
  5f06dbb

  Copy full SHA for 5f06dbb

Commits on Feb 21, 2024

• [Minor] black reformat

  ys-2020

  committed
  559f964

  Copy full SHA for 559f964

Commits on Nov 28, 2023

• format code

  

  Jiaming Tang

  committed
  8a763be

  Copy full SHA for 8a763be

Commits on Nov 7, 2023

• [Minor] Update evaluation

  

  Jiaming Tang

  committed
  bd929b9

  Copy full SHA for bd929b9

Commits on Nov 2, 2023

• refactor GeLU check

  Sakits

  committed
  a8f72ae

  Copy full SHA for a8f72ae

• refactor GeLU check

  Sakits

  committed
  3c36b3c

  Copy full SHA for 3c36b3c

Commits on Nov 1, 2023

• Support CodeLlama, StarCoder and StableCode

  

  Jiaming Tang

  committed
  02c1dd6

  Copy full SHA for 02c1dd6

Commits on Sep 18, 2023

• [Major] Add TinyChat support for GQA, faster context stage and memory efficient loading.

  kentang-mit

  committed
  ca11f3e

  Copy full SHA for ca11f3e

Commits on Sep 6, 2023

• [Major] Add new implementation of TinyChat.

  kentang-mit

  committed
  1480555

  Copy full SHA for 1480555

Commits on Aug 21, 2023

• [Minor] Temporarily change calibration dataset URL

  

  Jiaming Tang

  committed
  9c1ab9b

  Copy full SHA for 9c1ab9b

Commits on Aug 14, 2023

• [Minor] add a comment

  

  Jiaming Tang

  committed
  b190df3

  Copy full SHA for b190df3

• Add compatibility with GQA & optimize multi-GPU memory allocation

  

  Jiaming Tang

  committed
  9b427eb

  Copy full SHA for 9b427eb

Commits on Jul 26, 2023

• [Minor] accelerate loading quantized model

  

  Jiaming Tang

  committed
  f22c2a3

  Copy full SHA for f22c2a3

Commits on Jul 24, 2023

• [Major] Add TinyChat and demo.

  kentang-mit

  committed
  4f3e977

  Copy full SHA for 4f3e977

Commits on Jul 19, 2023

• Memory optimization

  

  Abhinav Kulkarni

  committed
  ba01560

  Copy full SHA for ba01560

Commits on Jul 9, 2023

• Added torch.cuda.empty_cache()

  

  Abhinav Kulkarni

  committed
  d2a10bd

  Copy full SHA for d2a10bd

Commits on Jul 4, 2023

• [Minor] Merge model initilization

  

  Jiaming Tang

  committed
  6371c3a

  Copy full SHA for 6371c3a

• [Minor] Added model dispatch to GPU logic

  

  Abhinav Kulkarni

  committed
  e04d0ec

  Copy full SHA for e04d0ec

• [Minor] Added model dispatch to GPU logic

  

  Abhinav Kulkarni

  committed
  df0c600

  Copy full SHA for df0c600

Commits on Jul 3, 2023

• [Minor] Added max-memory command line paramemter

  

  Abhinav Kulkarni

  committed
  4e7ada8

  Copy full SHA for 4e7ada8

Commits on Jul 1, 2023

• [Major] Add CPU offloading support for apply_scale, apply_clip, pseudo_quantize_model_weight, real_quantize_model_weight

  

  Abhinav Kulkarni

  committed
  d32095a

  Copy full SHA for d32095a

• [Major] Add CPU offloading support for apply_scale, apply_clip, pseudo_quantize_model_weight, real_quantize_model_weight

  

  Abhinav Kulkarni

  committed
  95cd9c2

  Copy full SHA for 95cd9c2

Commits on Jun 27, 2023

• [Minor] Auto-create the cache directory if not existing

  

  Jiaming Tang

  committed
  8e7e9cc

  Copy full SHA for 8e7e9cc

• [Major] Add CPU offloading support for run_awq

  

  Jiaming Tang

  committed
  34f1faf

  Copy full SHA for 34f1faf

Commits on Jun 26, 2023

• [Minor] fix loading awq checkpoint issue

  

  Jiaming Tang

  committed
  a293e16

  Copy full SHA for a293e16

Commits on Jun 25, 2023

• [Minor] add comments

  

  Jiaming Tang

  committed
  36913ed

  Copy full SHA for 36913ed

• [Minor] modify no_split_module_classes

  

  Jiaming Tang

  committed
  bef5dd2

  Copy full SHA for bef5dd2

• [Minor] Remove a compilation argument.

  kentang-mit

  committed
  29f52ea

  Copy full SHA for 29f52ea

• [Minor] skip qk bmm (Bloom, MPT, Falcon)

  

  Jiaming Tang

  committed
  80222c6

  Copy full SHA for 80222c6

• [Major] Add support for BLOOM, MPT and Falcon.

  kentang-mit

  committed
  71d8e68

  Copy full SHA for 71d8e68

Commits on Jun 7, 2023

• [Minor] fixed CUDA kernel launching bug

  ys-2020

  committed
  2a51f5e

  Copy full SHA for 2a51f5e

Commits on Jun 2, 2023

• [Minor] Add information for CUDA kernel.

  kentang-mit

  committed
  3a6dfc3

  Copy full SHA for 3a6dfc3

Commits on Jun 1, 2023

• first commit

  tonylins

  committed
  460d6d4

  Copy full SHA for 460d6d4

Loading