Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 29, 2023

• fixing typo in tiiuae/falcon-rw-7b model name (vllm-project#1226)

  0ssamaak0

  authored
  0967102

  Copy full SHA for 0967102

Commits on Sep 28, 2023

• Bump up the version to v0.2.0 (vllm-project#1212)

  WoosukKwon

  authored
  e2fb71e

  Copy full SHA for e2fb71e

• Provide default max model length (vllm-project#1224)

  WoosukKwon

  authored
  f936657

  Copy full SHA for f936657

• Fix OOM in attention kernel test (vllm-project#1223)

  WoosukKwon

  authored
  6f88f76

  Copy full SHA for 6f88f76

• Add Mistral to supported model list (vllm-project#1221)

  WoosukKwon

  authored
  202351d

  Copy full SHA for 202351d

• [Fix] Remove false assertion (vllm-project#1222)

  WoosukKwon

  authored
  2e8e49f

  Copy full SHA for 2e8e49f

• Fix Mistral model (vllm-project#1220)

  WoosukKwon

  authored
  a8e98ae

  Copy full SHA for a8e98ae

• [Mistral] Mistral-7B-v0.1 support (vllm-project#1196)

  Show description for bb1ba58
  

  Bam4d

  and

  timlacroix

  authored
  bb1ba58

  Copy full SHA for bb1ba58

• Add rope_scaling to Qwen (vllm-project#1210)

  Sanster

  authored
  7bedab5

  Copy full SHA for 7bedab5

• Add skip_special_tokens sampling params (vllm-project#1186)

  blahblahasdf

  authored
  20f7cc4

  Copy full SHA for 20f7cc4

• Use standard extras for uvicorn (vllm-project#1166)

  danilopeixoto

  authored
  649aa73

  Copy full SHA for 649aa73

Commits on Sep 27, 2023

• Automatically configure max_num_batched_tokens (vllm-project#1198)

  WoosukKwon

  authored
  a19bc5c

  Copy full SHA for a19bc5c

• fix qwen-14b model (vllm-project#1173)

  Sanster

  authored
  28e616c

  Copy full SHA for 28e616c

• fix typo (vllm-project#1184)

  Show description for 30e7752
  

  WrRan

  and

  zhuohan123

  authored
  30e7752

  Copy full SHA for 30e7752

• Support Longchat and RoPE scaling (vllm-project#555)

  Show description for 21877b0
  

  3 peopleauthored
  21877b0

  Copy full SHA for 21877b0

• Allocate more shared memory to attention kernel (vllm-project#1154)

  Yard1

  authored
  cf5cb1e

  Copy full SHA for cf5cb1e

Commits on Sep 26, 2023

• Add comments on RoPE initialization (vllm-project#1176)

  WoosukKwon

  authored
  03ffd0a

  Copy full SHA for 03ffd0a

• [Setup] Enable TORCH_CUDA_ARCH_LIST for selecting target GPUs (vllm-project#1074)

  WoosukKwon

  authored
  a425bd9

  Copy full SHA for a425bd9

Commits on Sep 24, 2023

• Align max_tokens behavior with openai (vllm-project#852)

  HermitSun

  authored
  bbbf865

  Copy full SHA for bbbf865

• Fix config for Falcon (vllm-project#1164)

  WoosukKwon

  authored
  9f6be86

  Copy full SHA for 9f6be86

• [FIX] Simplify sampler logic (vllm-project#1156)

  zhuohan123

  authored
  f187877

  Copy full SHA for f187877

Commits on Sep 23, 2023

• [Sampler] Vectorized sampling (simplified) (vllm-project#1048)

  Show description for 947b794
  

  zhuohan123

  and

  Yard1

  authored
  947b794

  Copy full SHA for 947b794

Commits on Sep 22, 2023

• Announce the First vLLM Meetup (vllm-project#1148)

  WoosukKwon

  authored
  8d926e9

  Copy full SHA for 8d926e9

• Docs: Fix broken link to openai example (vllm-project#1145)

  Show description for 4ee52bb
  nkpz

  authored
  4ee52bb

  Copy full SHA for 4ee52bb

• Use --ipc=host in docker run for distributed inference (vllm-project#1125)

  WoosukKwon

  authored
  7d7e3b7

  Copy full SHA for 7d7e3b7

Commits on Sep 21, 2023

• feat: support stop_token_ids parameter. (vllm-project#1097)

  gesanqiu

  authored
  f98b745

  Copy full SHA for f98b745

• clean api code, remove redundant background task. (vllm-project#1102)

  esmeetu

  authored
  2d1e86f

  Copy full SHA for 2d1e86f

• Add float16 and float32 (vllm-project#1115)

  WoosukKwon

  authored
  1ac4ccf

  Copy full SHA for 1ac4ccf

• Replace DtypeTensor (vllm-project#1123)

  WoosukKwon

  authored
  2ac4d5e

  Copy full SHA for 2ac4d5e

Commits on Sep 20, 2023

• rope_theta and max_position_embeddings from config (vllm-project#1096)

  Show description for 3302f0a
  

  3 peopleauthored
  3302f0a

  Copy full SHA for 3302f0a

• Add documentation to Triton server tutorial (vllm-project#983)

  tanmayv25

  authored
  6f2dd6c

  Copy full SHA for 6f2dd6c

• Add gpu_memory_utilization and swap_space to LLM (vllm-project#1090)

  WoosukKwon

  authored
  bc06445

  Copy full SHA for bc06445

Commits on Sep 19, 2023

• Add pyarrow to dependencies & Print warning on Ray import error (vllm-project#1094)

  WoosukKwon

  authored
  400b828

  Copy full SHA for 400b828

Commits on Sep 18, 2023

• [Community] Add vLLM Discord server (vllm-project#1086)

  zhuohan123

  authored
  c102631

  Copy full SHA for c102631

• Add minimum capability requirement for AWQ (vllm-project#1064)

  WoosukKwon

  authored
  2b1c116

  Copy full SHA for 2b1c116

Pagination

Previous

Next