Commits

Branch selector

 main

User selector

s5u13b

Datepicker

All time

Commit History

Commits on Jan 15, 2025

• [Manager] Optimize watch instance deployment states implementation & Add enable_port_offset_store arg (#92)

  s5u13b

  authored
  1f49b36

  Copy full SHA for 1f49b36

Commits on Jan 10, 2025

• [Deployment] Support global launch in addition to local launch (#88)

  s5u13b

  authored
  3e319f0

  Copy full SHA for 3e319f0

Commits on Jan 7, 2025

• [Deployment] Support initialize instance with placement group in manager for all migration backends (#89)

  s5u13b

  authored
  a98927c

  Copy full SHA for a98927c

Commits on Dec 13, 2024

• [Entrypoints] Use LlumnixClient class in entrypoints (#84)

  s5u13b

  authored
  4029b00

  Copy full SHA for 4029b00

Commits on Nov 12, 2024

• [Core][Migration] Support waiting request and multiple requests migration (#36)

  s5u13b

  authored
  e92c9ac

  Copy full SHA for e92c9ac

Commits on Oct 17, 2024

• [CI] Add launch modes and available blocks tests in e2e test (#57)

  s5u13b

  authored
  8d32ee9

  Copy full SHA for 8d32ee9

• [Entrypoints][Refactor] Refactor llumnix entrypoints to be more modular (#55)

  s5u13b

  authored
  dc98279

  Copy full SHA for dc98279

Commits on Oct 11, 2024

• [Observability] Collect request timestamps to observe the overhead introduced by system (#46)

  s5u13b

  authored
  b3b3810

  Copy full SHA for b3b3810

• [Core] Optimize request output tokens putting back implementation to reduce overhead (#45)

  s5u13b

  authored
  6de3bd7

  Copy full SHA for 6de3bd7

Commits on Sep 18, 2024

• [Misc] Implement post process of migration through asynchronous task done callback (#40)

  s5u13b

  authored
  500c6ed

  Copy full SHA for 500c6ed

• [Fix] Fix offline inference for zeromq queue (#39)

  s5u13b

  authored
  dcde210

  Copy full SHA for dcde210

Commits on Sep 11, 2024

• [Misc] Update instance info to global scheduler immediately once get one (#34)

  s5u13b

  authored
  7ce2905

  Copy full SHA for 7ce2905

• [BugFix] Fix incorrect config usage in api server (#33)

  s5u13b

  authored
  d174866

  Copy full SHA for d174866

Commits on Sep 10, 2024

• [Core] Use zeromq to put request output tokens back to the api server (#28)

  s5u13b

  authored
  c6ac5db

  Copy full SHA for c6ac5db

Commits on Sep 4, 2024

• [BugFix] Fix request output loss during putting back to the api server (#27)

  s5u13b

  authored
  5f11521

  Copy full SHA for 5f11521

Commits on Aug 30, 2024

• [BugFix][CI] Fix unittest errors caused by incorrect ray actor management (#23)

  s5u13b

  authored
  d05adc8

  Copy full SHA for d05adc8

Commits on Aug 29, 2024

• [Misc] Check manager and engine arguments in entrypoints (#19)

  s5u13b

  authored
  d4cd8fa

  Copy full SHA for d4cd8fa

• [Failover][BugFix] Fix duplicate requests caused by failover (#18)

  s5u13b

  authored
  30b5bf8

  Copy full SHA for 30b5bf8

Commits on Aug 27, 2024

• [Misc] Update instance info of engine in a timely manner (#17)

  s5u13b

  authored
  56c0c3c

  Copy full SHA for 56c0c3c

Commits on Aug 23, 2024

• [CI] Add unittest for global_scheduler and entrypoints (#12)

  s5u13b

  authored
  0b48bbc

  Copy full SHA for 0b48bbc

Commits on Aug 21, 2024

• [BugFix] Support initialize llumlet by manager (#11)

  s5u13b

  authored
  309c296

  Copy full SHA for 309c296

Commits on Aug 16, 2024

• [Misc] Rename manager arguments (#9)

  s5u13b

  authored
  e10bcec

  Copy full SHA for e10bcec

Commits on Jul 26, 2024

• [Misc] Change TODO id (#8)

  s5u13b

  authored
  688cd8e

  Copy full SHA for 688cd8e

• [Refactor] Refactor llumlet to better adapt to different backend engines (#4)

  s5u13b

  authored
  986a617

  Copy full SHA for 986a617

Commits on Jul 23, 2024

• Add pylint to CI (#3)

  s5u13b

  authored
  816e81d

  Copy full SHA for 816e81d