Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 20, 2023

• Add support for LLaMA-2 (vllm-project#505)

  zhuohan123

  authored
  6fc2a38

• Fix bad assert in initialize_cluster if PG already exists (vllm-project#526)

  Yard1

  authored
  c487a22

• Ray placement group support (vllm-project#397)

  Yard1

  authored
  9925c17

• fix: enable trust-remote-code in api server & benchmark. (vllm-project#509)

  gesanqiu

  authored
  8c4b259

• support trust_remote_code in benchmark (vllm-project#518)

  wangruohui

  authored
  cf21a9b

• fix(ray_utils): ignore re-init error (vllm-project#465)

  mspronesti

  authored
  16c3e29

Commits on Jul 18, 2023

• hotfix attn alibi wo head mapping (vllm-project#496)

  Show description for bda41c7
  

  Oliver-ss

  and

  oliveryuan

  authored
  bda41c7

• Merge pull request vllm-project#498 from MoeedDar/main

  Show description for 453bafb
  LiuXiaoxuanPKU

  authored
  453bafb

• Fixed old name reference for max_seq_len

  MoeedDar

  committed
  328d231

• fix max seq len (vllm-project#489)

  LiuXiaoxuanPKU

  authored
  b4b195b

Commits on Jul 17, 2023

• Add support for baichuan (vllm-project#365)

  codethazine

  authored
  20b0d88

• [Fix] Fix the condition of max_seq_len (vllm-project#477)

  zhuohan123

  authored
  2bdea7a

Commits on Jul 16, 2023

• [Doc] Add doc for running vLLM on the cloud (vllm-project#426)

  Show description for 58df288
  

  Michaelvll

  and

  zhuohan123

  authored
  58df288

• Offload port selection to OS (vllm-project#467)

  zhangir-azerbayev

  authored
  6d7d95a

Commits on Jul 15, 2023

• Optimize MQA Kernel (vllm-project#452)

  zhuohan123

  authored
  96853af

Commits on Jul 14, 2023

• Fix the KeyError when loading bloom-based models (vllm-project#441)

  HermitSun

  authored
  dbed690

• add vocab padding for LLama(Support WizardLM) (vllm-project#411)

  esmeetu

  authored
  7b6ae94

Commits on Jul 12, 2023

• Fix handling of special tokens in decoding. (vllm-project#418)

  xcnick

  authored
  c6dfc3c

• fix: freeze pydantic to v1 (vllm-project#429)

  kemingy

  authored
  51be365

Commits on Jul 9, 2023

• [Model] Add support for GPT-J (vllm-project#226)

  Show description for c894836
  

  AndreSlavescu

  and

  WoosukKwon

  authored
  c894836

Commits on Jul 8, 2023

• Don't try to load training_args.bin (vllm-project#373)

  lpfhs

  authored
  75beba2

• Add trust_remote_code arg to get_config (vllm-project#405)

  WoosukKwon

  authored
  ddfdf47

• Sort the outputs before return (vllm-project#402)

  WoosukKwon

  authored
  b6fbb9a

• avoid python list copy in sequence initialization (vllm-project#401)

  LiuXiaoxuanPKU

  authored
  2179e4f

Commits on Jul 7, 2023

• Add trust-remote-code flag to handle remote tokenizers (vllm-project#364)

  codethazine

  authored
  a945fcc

• [Fix] Change /generate response-type to json for non-streaming (vllm-project#374)

  nicolasf

  authored
  be54f8e

• fix: only response [DONE] once when streaming response. (vllm-project#378)

  gesanqiu

  authored
  b396cb4

Commits on Jul 5, 2023

• Bump up the version (vllm-project#300)

  WoosukKwon

  authored
  1c395b4

• [Server] use fastchat.model.model_adapter.get_conversation_template method to get model template (vllm-project#357)

  akxxsb

  authored
  3d64cf0

Commits on Jul 4, 2023

• [Server] Add option to specify chat template for chat endpoint (vllm-project#345)

  zhuohan123

  authored
  98fe8cb

Commits on Jul 3, 2023

• [Docs] Fix typo (vllm-project#346)

  WoosukKwon

  authored
  ffa6d2f

• [Model] Add support for MPT (vllm-project#334)

  WoosukKwon

  authored
  404422f

• Fix an endless loop issue when engine_step throws a RuntimeError (vllm-project#339)

  coolcloudcol

  authored
  7717d08

• [Quality] Add CI for formatting (vllm-project#343)

  zhuohan123

  authored
  42e0c1d

• Add support for BLOOM (vllm-project#331)

  WoosukKwon

  authored
  e41f067

Pagination

PreviousNext