Commits

Branch selector

 main

User selector

robertgshaw2-neuralmagic

Datepicker

All time

Commit History

Commits on Jan 13, 2025

• [V1] [2/n] Logging and Metrics - OutputProcessor Abstraction (#11973)

  Show description for 619ae26
  robertgshaw2-neuralmagic

  authored
  619ae26

  Copy full SHA for 619ae26

Commits on Jan 12, 2025

• [V1][Core][1/n] Logging and Metrics (#11962)

  Show description for 9597a09
  robertgshaw2-neuralmagic

  authored
  9597a09

  Copy full SHA for 9597a09

Commits on Jan 8, 2025

• [TPU][Quantization] TPU W8A8 (#11785)

  Show description for 56fe4c2
  

  robertgshaw2-neuralmagic

  and

  WoosukKwon

  authored
  56fe4c2

  Copy full SHA for 56fe4c2

Commits on Jan 5, 2025

• [Frontend] Improve StreamingResponse Exception Handling (#11752)

  robertgshaw2-neuralmagic

  authored
  33fc1e2

  Copy full SHA for 33fc1e2

Commits on Jan 3, 2025

• [V1] Chore: cruft removal (#11724)

  robertgshaw2-neuralmagic

  authored
  ad0d567

  Copy full SHA for ad0d567

• [V1] Improve TP>1 Error Handling + Stack Trace (#11721)

  Show description for 1543914
  

  robertgshaw2-neuralmagic

  and

  tlrmchlsmth

  authored
  1543914

  Copy full SHA for 1543914

• [V1] Simplify Shutdown (#11659)

  robertgshaw2-neuralmagic

  authored
  80c751e

  Copy full SHA for 80c751e

Commits on Dec 30, 2024

• [V1] [6/N] API Server: Better Shutdown (#11586)

  robertgshaw2-neuralmagic

  authored
  5886aa4

  Copy full SHA for 5886aa4

Commits on Dec 28, 2024

• [V1] [5/N] API Server: unify Detokenizer and EngineCore input (#11545)

  Show description for 4fb8e32
  robertgshaw2-neuralmagic

  authored
  4fb8e32

  Copy full SHA for 4fb8e32

• [V1] [4/N] API Server: ZMQ/MP Utilities (#11541)

  robertgshaw2-neuralmagic

  authored
  df04dff

  Copy full SHA for df04dff

Commits on Dec 27, 2024

• [BugFix] Fix quantization for all other methods (#11547)

  robertgshaw2-neuralmagic

  authored
  2339d59

  Copy full SHA for 2339d59

• [V1][3/N] API Server: Reduce Task Switching + Handle Abort Properly (#11534)

  robertgshaw2-neuralmagic

  authored
  1b875a0

  Copy full SHA for 1b875a0

• [CI] Fix broken CI (#11543)

  robertgshaw2-neuralmagic

  authored
  46d4359

  Copy full SHA for 46d4359

• Update openai_compatible_server.md (#11536)

  Show description for 0c0c201
  

  robertgshaw2-neuralmagic

  and

  simon-mo

  authored
  0c0c201

  Copy full SHA for 0c0c201

Commits on Dec 26, 2024

• [2/N] API Server: Avoid ulimit footgun (#11530)

  robertgshaw2-neuralmagic

  authored
  55fb97f

  Copy full SHA for 55fb97f

• [1/N] API Server (Remove Proxy) (#11529)

  robertgshaw2-neuralmagic

  authored
  720b10f

  Copy full SHA for 720b10f

Commits on Nov 11, 2024

• [V1] AsyncLLM Implementation (#9826)

  Show description for 6ace6fb
  

  4 peopleauthored
  6ace6fb

  Copy full SHA for 6ace6fb

Commits on Nov 4, 2024

• [Bugfix] Fix MQLLMEngine hanging (#9973)

  Show description for 04cef2c
  robertgshaw2-neuralmagic

  authored
  04cef2c

  Copy full SHA for 04cef2c

• [CI] Basic Integration Test For TPU (#9968)

  Show description for 1c45f4c
  robertgshaw2-neuralmagic

  authored
  1c45f4c

  Copy full SHA for 1c45f4c

• [V1] Fix Configs (#9971)

  robertgshaw2-neuralmagic

  authored
  91c9ebb

  Copy full SHA for 91c9ebb

Commits on Nov 2, 2024

• [V1] Fix EngineArgs refactor on V1 (#9954)

  robertgshaw2-neuralmagic

  authored
  d6459b4

  Copy full SHA for d6459b4

Commits on Oct 28, 2024

• Fix beam search eos (#9627)

  robertgshaw2-neuralmagic

  authored
  feb92fb

  Copy full SHA for feb92fb

Commits on Oct 17, 2024

• Support BERTModel (first encoder-only embedding model) (#9056)

  Show description for 343f8e0
  

  6 peopleauthored
  343f8e0

  Copy full SHA for 343f8e0

Commits on Aug 31, 2024

• [BugFix][Core] Multistep Fix Crash on Request Cancellation (#8059)

  robertgshaw2-neuralmagic

  authored
  8423aef

  Copy full SHA for 8423aef

Commits on Aug 21, 2024

• [Frontend] Improve Startup Failure UX (#7716)

  robertgshaw2-neuralmagic

  authored
  970dfdc

  Copy full SHA for 970dfdc

• [Bugfix][Frontend] Fix Issues Under High Load With zeromq Frontend (#7394)

  Show description for f7e3b0c
  

  robertgshaw2-neuralmagic

  and

  njhill

  authored
  f7e3b0c

  Copy full SHA for f7e3b0c

Commits on Aug 18, 2024

• [ Bugfix ] Fix Prometheus Metrics With zeromq Frontend (#7279)

  Show description for e3b3182
  

  robertgshaw2-neuralmagic

  and

  njhill

  authored
  e3b3182

  Copy full SHA for e3b3182

Commits on Aug 7, 2024

• [ BugFix ] Move zmq frontend to IPC instead of TCP (#7222)

  robertgshaw2-neuralmagic

  authored
  5649857

  Copy full SHA for 5649857

Commits on Aug 6, 2024

• [ BugFix ] Fix ZMQ when VLLM_PORT is set (#7205)

  robertgshaw2-neuralmagic

  authored
  541c185

  Copy full SHA for 541c185

Commits on Aug 3, 2024

• [ Frontend ] Multiprocessing for OpenAI Server with zeromq (#6883)

  Show description for ed812a7
  

  4 peopleauthored
  ed812a7

  Copy full SHA for ed812a7

Commits on Jul 25, 2024

• [ Misc ] fp8-marlin channelwise via compressed-tensors (#6524)

  Show description for 889da13
  

  robertgshaw2-neuralmagic

  and

  mgoin

  authored
  889da13

  Copy full SHA for 889da13

Commits on Jul 20, 2024

• [ Bugfix ] Fix AutoFP8 fp8 marlin (#6609)

  robertgshaw2-neuralmagic

  authored
  082ecd8

  Copy full SHA for 082ecd8

• [ Kernel ] Enable fp8-marlin for fbgemm-fp8 models (#6606)

  robertgshaw2-neuralmagic

  authored
  9364f74

  Copy full SHA for 9364f74

• [ Misc ] fbgemm checkpoints (#6559)

  robertgshaw2-neuralmagic

  authored
  683e3cb

  Copy full SHA for 683e3cb

Commits on Jul 19, 2024

• [ Kernel ] Enable Dynamic Per Token fp8 (#6547)

  robertgshaw2-neuralmagic

  authored
  4cc24f0

  Copy full SHA for 4cc24f0

Pagination

Previous

Next