Commits

Branch selector

 0607aeb

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 22, 2023

• fix (ModelTC#261)

  hiworldwzj

  authored
  0607aeb

Commits on Dec 21, 2023

• [feature]Splitfuse int8kv kernel (ModelTC#260)

  Show description for e0863cb
  wxd000000

  authored
  e0863cb

• add ppl int8 quant mode (ModelTC#259)

  Show description for 7a39e1a
  

  fuheaven

  and

  hiworldwzj

  authored
  7a39e1a

Commits on Dec 20, 2023

• fix skip speical tokens (ModelTC#258)

  Show description for 71771bc
  

  shihaobai

  and

  baishihao

  authored
  71771bc

• fix log (ModelTC#257)

  hiworldwzj

  authored
  026182c

• fix log. (ModelTC#256)

  hiworldwzj

  authored
  8897201

• Add unified log utility for lightllm (ModelTC#255)

  Show description for 9737fd4
  

  flyinglandlord

  and

  hiworldwzj

  authored
  9737fd4

Commits on Dec 19, 2023

• Update to make splitfuse_mode can run rightly when using triton-nightly. (ModelTC#254)

  hiworldwzj

  authored
  1c2001d

• [Feature] support to output all prompt logprobs. (ModelTC#253)

  Show description for 360e092
  

  hiworldwzj

  and

  wangzaijun

  authored
  360e092

Commits on Dec 18, 2023

• fix precision for ppl int4 quant (ModelTC#250)

  fuheaven

  authored
  a507f16

Commits on Dec 15, 2023

• Fix special token id filter (ModelTC#249)

  Show description for 966b57e
  

  huochaitiantang

  and

  liuliang1

  authored
  966b57e

• [mistral] swa (ModelTC#248)

  Show description for 585999a
  

  ANDgate99

  and

  hiworldwzj

  authored
  585999a

Commits on Dec 14, 2023

• Upgrade gqa attention kernel. (ModelTC#247)

  hiworldwzj

  authored
  bda7154

Commits on Dec 7, 2023

• Adaptation of InternLM to GQA (ModelTC#243)

  Show description for a9cf015
  

  shihaobai

  and

  baishihao

  authored
  a9cf015

Commits on Dec 5, 2023

• add lmdeploy int4 weight quant mode (ModelTC#238)

  fuheaven

  authored
  d55c561

Commits on Dec 4, 2023

• upgrade gqa kernel to mode setting. (ModelTC#242)

  Show description for d4f3c8c
  

  hiworldwzj

  and

  wangzaijun

  authored
  d4f3c8c

Commits on Dec 1, 2023

• fix the bug of weight multiprocess loading (ModelTC#237)

  shihaobai

  authored
  923e950

• support ppl fp16 attention (ModelTC#235)

  hiworldwzj

  authored
  50d99a6

Commits on Nov 30, 2023

• upgrade router len calcu way. (ModelTC#232)

  Show description for f2a9b45
  

  hiworldwzj

  and

  wangzaijun

  authored
  f2a9b45

Commits on Nov 29, 2023

• [feature] GQA triton flashdecoding kernel (ModelTC#231)

  Show description for eaa1b96
  

  hiworldwzj

  and

  wangzaijun

  authored
  eaa1b96

Commits on Nov 28, 2023

• fix (ModelTC#229)

  hiworldwzj

  authored
  acfa90e

• [feature] fast GQA decode attention kernel. (ModelTC#228)

  Show description for 2c071eb
  

  hiworldwzj

  and

  wangzaijun

  authored
  2c071eb

• fix splitfuse kernel bug (ModelTC#227)

  hiworldwzj

  authored
  00d37c6

Commits on Nov 27, 2023

• [Feature] Prompt cache and Splitfuse. (ModelTC#226)

  Show description for 8075c3d
  hiworldwzj

  authored
  8075c3d

• Update version to 2.0.0 (ModelTC#225)

  hiworldwzj

  authored
  8b8a4e1

Commits on Nov 21, 2023

• add args no_skipping_special_tokens and no_spaces_between_special_tokens (ModelTC#221)

  ChieloNewctle

  authored
  84671a7

Commits on Nov 20, 2023

• add gpu name for test all settings. (ModelTC#220)

  Show description for afe4054
  

  hiworldwzj

  and

  wangzaijun

  authored
  afe4054

Commits on Nov 17, 2023

• Update README.md (ModelTC#219)

  hiworldwzj

  authored
  dd69878

• support Baichuan2-13b model (ModelTC#218)

  Show description for e2b95c5
  wxd000000

  authored
  e2b95c5

Commits on Nov 16, 2023

• fix bug for lose token (ModelTC#216)

  Show description for aceeb6e
  

  hiworldwzj

  and

  wangzaijun

  authored
  aceeb6e

• fix Ppl int4 python impl bug (ModelTC#215)

  fuheaven

  authored
  8f33eb6

Commits on Nov 15, 2023

• add ppl int4 kernel (ModelTC#211)

  fuheaven

  authored
  46c0a80

Commits on Nov 14, 2023

• add support for repetition_penalty (ModelTC#213)

  Show description for f49bdae
  

  shihaobai

  and

  baishihao

  authored
  f49bdae

Commits on Nov 13, 2023

• add test setting tools code (ModelTC#212)

  Show description for 6560353
  

  hiworldwzj

  and

  wangzaijun

  authored
  6560353

• fix bug for ModelTC#208 (ModelTC#210)

  Show description for a684be4
  

  hiworldwzj

  and

  wangzaijun

  authored
  a684be4

Pagination

PreviousNext