6 Pull requests merged by 3 people

• [Core] Support async output processing when disabling migration

  #114 merged Feb 26, 2025

• [Docs] Improve centralized launch related texts in documents

  #113 merged Feb 25, 2025

• [CI] Add simulator e2e test and tensor parallelism unit test and e2e test

  #112 merged Feb 25, 2025

• [BugFix] Fix missing parameter in instance.generate() call

  #107 merged Feb 25, 2025

• [BugFix] Only call ray.shutdown when necessary in ray_env fixture to avoid ray error during ci tests

  #108 merged Feb 24, 2025

• [Bugfix] Fix the issue with incorrect PR comment creation for CI tests

  #111 merged Feb 24, 2025

3 Pull requests opened by 2 people

• [WIP][Core][Migration] Support concurrent migration

  #115 opened Feb 26, 2025

• [wip] [Refactor] use zmq socket pool

  #116 opened Feb 27, 2025

• [Core][Migration] Ensure live migration correctness when enabling async output process or using ray spmd worker

  #117 opened Feb 28, 2025

1 Issue closed by 1 person

• Performance Comparison Between vLLM and Llumnix Deployment

  #100 closed Feb 26, 2025

2 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [WIP-BladeLLM] Support migration feature for BladeLLM

  #90 commented on Feb 26, 2025 • 0 new comments

• [Core] Support use_ray_spmd_worker and scheduler that only sending delta data

  #105 commented on Feb 27, 2025 • 0 new comments