Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 1, 2024

• Feature(MInference): support LLaMA-3-70B-1M and multi-gpu PP (microsoft#59)

  Show description for 7a11a33
  

  4 peopleauthored
  7a11a33

  Copy full SHA for 7a11a33

Commits on Jul 24, 2024

• Feature(MInference): support llama 3.1 (microsoft#54)

  Show description for b5b8745
  

  4 peopleauthored
  b5b8745

  Copy full SHA for b5b8745

Commits on Jul 18, 2024

• Feature(MInference): add e2e benchmark using vllm (microsoft#49)

  Show description for ddfb462
  

  3 peopleauthored
  ddfb462

  Copy full SHA for ddfb462

Commits on Jul 16, 2024

• Hotfix(MInference): fix vllm>=0.4.1 (microsoft#44)

  Show description for 0b9c81b
  

  3 peopleauthored
  0b9c81b

  Copy full SHA for 0b9c81b

Commits on Jul 15, 2024

• Feature(MInference): add triton-based decoding in case flash_attn is not available (microsoft#35)

  Show description for 50d17d9
  

  liyucheng09

  and

  iofu728

  authored
  50d17d9

  Copy full SHA for 50d17d9

Commits on Jul 12, 2024

• Prerelease(MInference): for 0.1.4.post2 (microsoft#32)

  Show description for a880a6e
  

  3 peopleauthored
  a880a6e

  Copy full SHA for a880a6e

• Feature(MInference): add unittest (microsoft#31)

  Show description for 1dd709f
  

  3 peopleauthored
  1dd709f

  Copy full SHA for 1dd709f

• Hotfix(MInference): fix the import warnings, fix the apply_rotary_pos_emb_single, fix phi-3 vs kernel (microsoft#30)

  Show description for d2d8747
  

  3 peopleauthored
  d2d8747

  Copy full SHA for d2d8747

Commits on Jul 7, 2024

• Feature(MInference): update HF demo information, thanks @ak's sponsoring (microsoft#22)

  Show description for 19c3c7e
  

  3 peopleauthored
  19c3c7e

  Copy full SHA for 19c3c7e

• Feature(MInference): add vllm support for 0.4.2 and 0.4.3 (microsoft#19)

  Show description for dbe9029
  

  liyucheng09

  and

  iofu728

  authored
  dbe9029

  Copy full SHA for dbe9029

Commits on Jul 5, 2024

• Prerelease(MInference): update version (microsoft#15)

  Show description for 427b1dd
  

  3 peopleauthored
  427b1dd

  Copy full SHA for 427b1dd

• Hotfix(MInference): fix the configs in pip (microsoft#14)

  Show description for 1c2bf70
  

  3 peopleauthored
  1c2bf70

  Copy full SHA for 1c2bf70

Commits on Jul 4, 2024

• Feature(MInference): add bdist cache (microsoft#11)

  Show description for 00666fb
  

  3 peopleauthored
  00666fb

  Copy full SHA for 00666fb

• Hotfix(Minference): fix the yaml (microsoft#10)

  Show description for 41f8cea
  

  3 peopleauthored
  41f8cea

  Copy full SHA for 41f8cea

• Hotfix(MInference): fix the yaml (microsoft#9)

  Show description for 019023f
  

  3 peopleauthored
  019023f

  Copy full SHA for 019023f

• Hotfix(MInference): fix the pip setup (microsoft#8)

  Show description for 7e06bd3
  

  3 peopleauthored
  7e06bd3

  Copy full SHA for 7e06bd3

Commits on Jul 3, 2024

• Hotfix(MInference): fix the pip setup issue (microsoft#6)

  Show description for cfda78c
  

  3 peopleauthored
  cfda78c

  Copy full SHA for cfda78c

• Merge pull request microsoft#5 from microsoft/hjiang/add_paper

  Show description for 038e005
  

  3 peopleauthored
  038e005

  Copy full SHA for 038e005

• Feature(MInference): add arXiv paper

  iofu728

  committed
  e493538

  Copy full SHA for e493538

• Feature(MInference): add arXiv paper

  iofu728

  committed
  98a9fcc

  Copy full SHA for 98a9fcc

• Merge pull request microsoft#4 from microsoft/hjiang/fix_unittest

  Show description for 569bb34
  

  3 peopleauthored
  569bb34

  Copy full SHA for 569bb34

• Feature(MInference): fix unittest

  iofu728

  committed
  d047686

  Copy full SHA for d047686

• Merge pull request microsoft#3 from microsoft/hjiang/update_paper

  Show description for bf437a2
  

  3 peopleauthored
  bf437a2

  Copy full SHA for bf437a2

• Feature(MInference): update paper information

  iofu728

  committed
  03f84cc

  Copy full SHA for 03f84cc

Commits on Jul 2, 2024

• Feature(MInference): update release scripts

  iofu728

  committed
  74be391

  Copy full SHA for 74be391

• Merge pull request microsoft#2 from microsoft/hjiang/MInference

  Show description for eb922ea
  

  3 peopleauthored
  eb922ea

  Copy full SHA for eb922ea

• Feature(MInference): remove unittest

  iofu728

  committed
  1c414a4

  Copy full SHA for 1c414a4

• Feature(MInference): prepare for release

  iofu728

  committed
  a9583e0

  Copy full SHA for a9583e0

• fix bugs in vllm patch

  liyucheng09

  committed
  ceba21b

  Copy full SHA for ceba21b

• Feature(MInference): add supported models

  iofu728

  committed
  2c48613

  Copy full SHA for 2c48613

Commits on Jul 1, 2024

• Feature(MInference): update the example

  iofu728

  committed
  882dcc6

  Copy full SHA for 882dcc6

• Feature(MInference): update the pip release script, logo, and copyright

  iofu728

  committed
  fbfd9fb

  Copy full SHA for fbfd9fb

Commits on Jun 30, 2024

• Feature(MInference): update FAQ

  iofu728

  committed
  0aff9c3

  Copy full SHA for 0aff9c3

• Feature(MInference): update logo

  iofu728

  committed
  db22985

  Copy full SHA for db22985

Commits on Jun 29, 2024

• Feature(MInference): update FAQ

  iofu728

  committed
  9c4b960

  Copy full SHA for 9c4b960

Pagination

Previous

Next