Commits

Branch selector

 main

User selector

hiworldwzj

Datepicker

All time

Commit History

Commits on May 20, 2024

• Add tokens http interface (ModelTC#412)

  Show description for 53f65ef
  

  hiworldwzj

  and

  wangzaijun

  authored
  53f65ef

• fix bug for w8a8 mode (ModelTC#411)

  Show description for a775bd3
  

  hiworldwzj

  and

  wangzaijun

  authored
  a775bd3

Commits on May 15, 2024

• 【Feature】 Refactor the code and add support for multi-output features like beam search. (ModelTC#409)

  Show description for e6452fd
  

  4 peopleauthored
  e6452fd

Commits on Apr 12, 2024

• remove the support for triton==2.0.0 (ModelTC#395)

  Show description for bcb3212
  

  hiworldwzj

  and

  wangzaijun

  authored
  bcb3212

Commits on Apr 1, 2024

• add min_new_tokens sampling parameter (ModelTC#384)

  hiworldwzj

  authored
  a231505

Commits on Mar 29, 2024

• w6a16 mode (ModelTC#382)

  hiworldwzj

  authored
  7cd10a0

Commits on Mar 26, 2024

• fix eos_id default value to [2] (ModelTC#378)

  hiworldwzj

  authored
  78047d1

• Update model.py To Fix ntk length bug. (ModelTC#375)

  hiworldwzj

  authored
  aa98b35

Commits on Mar 21, 2024

• Bug Fix ModelTC#368 (ModelTC#370)

  Show description for c3dc640
  

  hiworldwzj

  and

  wangzaijun

  authored
  c3dc640

• add cuda int4kv copy kernel (ModelTC#369)

  Show description for c5d6794
  

  hiworldwzj

  and

  wangzaijun

  authored
  c5d6794

Commits on Mar 20, 2024

• add mode ppl_int4kv_flashdecoding (ModelTC#367)

  hiworldwzj

  authored
  859a48b

Commits on Mar 19, 2024

• Update context_flashattention_nopad.py To fix triton 2.0.0 import error. (ModelTC#364)

  hiworldwzj

  authored
  56940dd

• add ppl int8kv flashdecoding mode (ModelTC#363)

  hiworldwzj

  authored
  c96e5d5

Commits on Mar 18, 2024

• To improve the code's compatibility with different PyTorch versions. (ModelTC#361)

  Show description for 6d67fbb
  

  hiworldwzj

  and

  wangzaijun

  authored
  6d67fbb

• fix requirements.txt (ModelTC#360)

  hiworldwzj

  authored
  8debc65

• [Feature] Dynamic prompt cache (ModelTC#356)

  Show description for f1f66fe
  

  6 peopleauthored
  f1f66fe

Commits on Mar 14, 2024

• Update silu_and_mul.py to fix the int32 overflow issue (ModelTC#354)

  hiworldwzj

  authored
  e2b5168

Commits on Mar 4, 2024

• Fix bug for rope_scaling in config.josn is None (ModelTC#344)

  hiworldwzj

  authored
  b1a73ec

Commits on Feb 19, 2024

• Update test_settings.py (ModelTC#331)

  hiworldwzj

  authored
  2e6f961

Commits on Feb 5, 2024

• fix support for model_type internlm2 (ModelTC#328)

  hiworldwzj

  authored
  b4541bd

Commits on Jan 25, 2024

• [Update] KV Merge And FFn up gate merge. (ModelTC#320)

  Show description for 00aeedc
  

  5 peopleauthored
  00aeedc

Commits on Jan 16, 2024

• fix bug when vob_size % world_size != 0 (ModelTC#300)

  hiworldwzj

  authored
  720f9d7

Commits on Jan 10, 2024

• add ppl_fp16_flashdecoding kernel support (ModelTC#292)

  hiworldwzj

  authored
  98d93f3

Commits on Jan 9, 2024

• Revert "add ceph-based model loading" (ModelTC#289)

  Show description for 307c0ed
  hiworldwzj

  authored
  307c0ed

Commits on Jan 5, 2024

• fix for torch 1.13 (ModelTC#283)

  hiworldwzj

  authored
  e9d9833

Commits on Jan 4, 2024

• add mulitmodal_emb kernel (ModelTC#278)

  Show description for 90af2ab
  

  hiworldwzj

  and

  wangzaijun

  authored
  90af2ab

Commits on Dec 28, 2023

• Fix (ModelTC#270)

  Show description for 7b21936
  

  hiworldwzj

  and

  wangzaijun

  authored
  7b21936

Commits on Dec 25, 2023

• [feature] long_truncation_mode supported (ModelTC#265)

  Show description for f2a54f0
  

  hiworldwzj

  and

  wangzaijun

  authored
  f2a54f0

Commits on Dec 22, 2023

• fix (ModelTC#261)

  hiworldwzj

  authored
  0607aeb

Commits on Dec 20, 2023

• fix log (ModelTC#257)

  hiworldwzj

  authored
  026182c

• fix log. (ModelTC#256)

  hiworldwzj

  authored
  8897201

Commits on Dec 19, 2023

• Update to make splitfuse_mode can run rightly when using triton-nightly. (ModelTC#254)

  hiworldwzj

  authored
  1c2001d

• [Feature] support to output all prompt logprobs. (ModelTC#253)

  Show description for 360e092
  

  hiworldwzj

  and

  wangzaijun

  authored
  360e092

Commits on Dec 14, 2023

• Upgrade gqa attention kernel. (ModelTC#247)

  hiworldwzj

  authored
  bda7154

Commits on Dec 4, 2023

• upgrade gqa kernel to mode setting. (ModelTC#242)

  Show description for d4f3c8c
  

  hiworldwzj

  and

  wangzaijun

  authored
  d4f3c8c

Pagination

PreviousNext