Commits

Breadcrumbs

History for

onsupport-stablelm-2

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 23, 2024

• lint: format all python file instead of just source code (#2567)

  simon-mo

  authored
  1e4277d

  Copy full SHA for 1e4277d

• [Experimental] Add multi-LoRA support (#1804)

  Show description for 9b945da
  

  4 peopleauthored
  9b945da

  Copy full SHA for 9b945da

Commits on Jan 18, 2024

• Minor fix in prefill cache example (#2494)

  JasonZhu1313

  authored
  5d80a91

  Copy full SHA for 5d80a91

• [Experimental] Prefix Caching Support (#1669)

  Show description for d10f8e1
  

  3 peopleauthored
  d10f8e1

  Copy full SHA for d10f8e1

Commits on Jan 12, 2024

• Add gradio chatbot for openai webserver (#2307)

  arkohut

  authored
  9746058

  Copy full SHA for 9746058

Commits on Jan 9, 2024

• Add baichuan chat template jinjia file (#2390)

  taaaaaake

  authored
  74cd5ab

  Copy full SHA for 74cd5ab

Commits on Jan 3, 2024

• Remove deprecated parameter: concurrency_count (#2315)

  ronensc

  authored
  1066cbd

  Copy full SHA for 1066cbd

Commits on Dec 3, 2023

• chore(examples-docs): upgrade to OpenAI V1 (#1785)

  mspronesti

  authored
  c07a442

  Copy full SHA for c07a442

Commits on Dec 1, 2023

• Support chat template and echo for chat API (#1756)

  Tostino

  authored
  66785cc

  Copy full SHA for 66785cc

Commits on Oct 30, 2023

• Refactor LLMEngine demo script for clarity and modularity (#1413)

  Show description for ac8d36f
  

  iongpt

  and

  zhuohan123

  authored
  ac8d36f

  Copy full SHA for ac8d36f

Commits on Oct 16, 2023

• Implement prompt logprobs & Batched topk for computing logprobs (#1328)

  Show description for 9d9072a
  

  zhuohan123

  and

  wanmok

  authored
  9d9072a

  Copy full SHA for 9d9072a

Commits on Oct 7, 2023

• API server support ipv4 / ipv6 dualstack (#1288)

  Show description for 09ff7f1
  

  yunfeng-scale

  and

  zhuohan123

  authored
  09ff7f1

  Copy full SHA for 09ff7f1

Commits on Aug 2, 2023

• Refactor scheduler (#658)

  WoosukKwon

  authored
  55fe8a8

  Copy full SHA for 55fe8a8

• Add Falcon support (new) (#592)

  zhuohan123

  authored
  1b0bd0f

  Copy full SHA for 1b0bd0f

Commits on Jul 26, 2023

• [Fix] Add chat completion Example and simplify dependencies (#576)

  zhuohan123

  authored
  82ad323

  Copy full SHA for 82ad323

Commits on Jul 3, 2023

• [Quality] Add code formatter and linter (#326)

  zhuohan123

  authored
  d6fa1be

  Copy full SHA for d6fa1be

Commits on Jun 22, 2023

• [Bugfix] Fix a bug in RequestOutput.finished (#202)

  WoosukKwon

  authored
  14f0b39

  Copy full SHA for 14f0b39

Commits on Jun 17, 2023

• Change the name to vLLM (#150)

  WoosukKwon

  authored
  0b98ba1

  Copy full SHA for 0b98ba1

• Rename servers to engines (#152)

  zhuohan123

  authored
  e5464ee

  Copy full SHA for e5464ee

Commits on Jun 16, 2023

• Rename servers and change port numbers to reduce confusion (#149)

  zhuohan123

  authored
  eedb46b

  Copy full SHA for eedb46b

Commits on Jun 15, 2023

• Add script for benchmarking serving throughput (#145)

  WoosukKwon

  authored
  311490a

  Copy full SHA for 311490a

Commits on Jun 10, 2023

• Non-streaming simple fastapi server (#144)

  zhuohan123

  authored
  5020e1e

  Copy full SHA for 5020e1e

Commits on Jun 7, 2023

• Add docstrings for LLMServer and related classes and examples (#142)

  zhuohan123

  authored
  4298374

  Copy full SHA for 4298374

Commits on May 28, 2023

• Add throughput benchmarking script (#133)

  WoosukKwon

  authored
  211318d

  Copy full SHA for 211318d

Commits on May 24, 2023

• OpenAI Compatible Frontend (#116)

  zhuohan123

  authored
  057daef

  Copy full SHA for 057daef

Commits on May 22, 2023

• Introduce LLM class for offline inference (#115)

  WoosukKwon

  authored
  655a5e4

  Copy full SHA for 655a5e4

Commits on May 21, 2023

• Implement stop strings and best_of (#114)

  WoosukKwon

  authored
  f746ced

  Copy full SHA for f746ced

Commits on May 20, 2023

• Refactor system architecture (#109)

  WoosukKwon

  authored
  c3442c1

  Copy full SHA for c3442c1

Loading