Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 4, 2024

• Fix bug for rope_scaling in config.josn is None (ModelTC#344)

  hiworldwzj

  authored
  b1a73ec

• Fix weight only quant bug. (ModelTC#342)

  Show description for 982e802
  

  helloyongyang

  and

  hiworldwzj

  authored
  982e802

• add dynamic parse for internlm2 (ModelTC#341)

  Show description for 01a87de
  

  shihaobai

  and

  baishihao

  authored
  01a87de

Commits on Feb 27, 2024

• add support for MiniCPM (ModelTC#338)

  shihaobai

  authored
  f50db5c

Commits on Feb 26, 2024

• add support for stablelm & add adaption for partial rotrary pos emb (ModelTC#336)

  shihaobai

  authored
  35f6d85

• add support for internlmxcomposer (ModelTC#334)

  Show description for 0afef5b
  

  3 peopleauthored
  0afef5b

Commits on Feb 20, 2024

• read the img size from the config (ModelTC#332)

  Show description for 163e845
  

  shihaobai

  and

  baishihao

  authored
  163e845

Commits on Feb 19, 2024

• Update test_settings.py (ModelTC#331)

  hiworldwzj

  authored
  2e6f961

Commits on Feb 18, 2024

• add details info for streaming generation (ModelTC#330)

  Show description for 7d48473
  

  3 peopleauthored
  7d48473

Commits on Feb 5, 2024

• fix support for model_type internlm2 (ModelTC#328)

  hiworldwzj

  authored
  b4541bd

Commits on Jan 26, 2024

• 128 k (ModelTC#322)

  Show description for caf65f5
  

  shihaobai

  and

  baishihao

  authored
  caf65f5

Commits on Jan 25, 2024

• [Update] KV Merge And FFn up gate merge. (ModelTC#320)

  Show description for 00aeedc
  

  5 peopleauthored
  00aeedc

Commits on Jan 23, 2024

• Fix tp id for triton kernel (ModelTC#313)

  Show description for 4a9824b
  

  huochaitiantang

  and

  liuliang1

  authored
  4a9824b

Commits on Jan 17, 2024

• fix bug for qwen without dynamic ntk (ModelTC#303)

  Show description for 8ecd84d
  

  shihaobai

  and

  baishihao

  authored
  8ecd84d

Commits on Jan 16, 2024

• fix PetrelHelper (ModelTC#299)

  Show description for 9659c53
  

  wxd000000

  and

  wxd000000

  authored
  9659c53

• fix bug when vob_size % world_size != 0 (ModelTC#300)

  hiworldwzj

  authored
  720f9d7

Commits on Jan 12, 2024

• Fix when request << capacity, alloc too frequency, caused low throughput (ModelTC#297)

  Show description for 348e45c
  

  huochaitiantang

  and

  liuliang1

  authored
  348e45c

• Code Style Improvement (ModelTC#282)

  Show description for 95d736c
  

  flyinglandlord

  and

  hiworldwzj

  authored
  95d736c

Commits on Jan 11, 2024

• add test script (ModelTC#295)

  Show description for bd4de1c
  

  wxd000000

  and

  wxd000000

  authored
  bd4de1c

• add support for internlm2 (ModelTC#293)

  Show description for 20bc7a9
  

  shihaobai

  and

  baishihao

  authored
  20bc7a9

Commits on Jan 10, 2024

• add ppl_fp16_flashdecoding kernel support (ModelTC#292)

  hiworldwzj

  authored
  98d93f3

Commits on Jan 9, 2024

• add ceph-based model loading (ModelTC#290)

  Show description for 7828e80
  

  wxd000000

  and

  wxd000000

  authored
  7828e80

• Revert "add ceph-based model loading" (ModelTC#289)

  Show description for 307c0ed
  hiworldwzj

  authored
  307c0ed

Commits on Jan 8, 2024

• add ceph-based model loading (ModelTC#288)

  wxd000000

  authored
  b87119e

• Return meaningful finish reason instead of a boolean (ModelTC#285)

  Show description for 2a56868
  

  zeyugao

  and

  hiworldwzj

  authored
  2a56868

Commits on Jan 5, 2024

• Revert "[refactor] merge rotary_emb_fwd and destindex_copy_kv for streamlined execution" (ModelTC#284)

  Show description for 3030409
  shihaobai

  authored
  3030409

• fix for torch 1.13 (ModelTC#283)

  hiworldwzj

  authored
  e9d9833

• Multi embed (ModelTC#281)

  Show description for 0fb15ea
  

  huochaitiantang

  and

  liuliang1

  authored
  0fb15ea

• [refactor] merge rotary_emb_fwd and destindex_copy_kv for streamlined execution (ModelTC#280)

  Show description for 76e0145
  

  3 peopleauthored
  76e0145

Commits on Jan 4, 2024

• add mulitmodal_emb kernel (ModelTC#278)

  Show description for 90af2ab
  

  hiworldwzj

  and

  wangzaijun

  authored
  90af2ab

• fix batch merge for dynamic ntk (ModelTC#276)

  Show description for 5600cf6
  

  shihaobai

  and

  baishihao

  authored
  5600cf6

Commits on Jan 3, 2024

• feat(): add some feature and fixed T4, V100 triton error (ModelTC#275)

  Show description for 8837ecb
  

  3 peopleauthored
  8837ecb

Commits on Jan 2, 2024

• [mistral] fix sliding_window = null (ModelTC#273)

  ANDgate99

  authored
  518f239

• fix precision of dynamic ntk (ModelTC#272)

  Show description for d81c6db
  

  shihaobai

  and

  baishihao

  authored
  d81c6db

Commits on Dec 28, 2023

• Fix (ModelTC#270)

  Show description for 7b21936
  

  hiworldwzj

  and

  wangzaijun

  authored
  7b21936

Pagination

PreviousNext