Commits

Branch selector

 main

User selector

ByronHsu

Datepicker

All time

Commit History

Commits on Jan 28, 2025

• [kernel] Use sgl_kernel rope (#3169)

  Show description for 988d0a4
  

  ByronHsu

  and

  zhyncs

  authored
  988d0a4

  Copy full SHA for 988d0a4

• [test] deduplicate test_session_control (#3183)

  ByronHsu

  authored
  27aeb4b

  Copy full SHA for 27aeb4b

Commits on Jan 27, 2025

• [kernel] Fix position ids in rope (#3173)

  ByronHsu

  authored
  514f37c

  Copy full SHA for 514f37c

• Bump sgl kernel to 0.0.2.post19 (#3167)

  ByronHsu

  authored
  741fccd

  Copy full SHA for 741fccd

• [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134)

  ByronHsu

  authored
  fb11a43

  Copy full SHA for fb11a43

Commits on Jan 24, 2025

• [router] Fix twine uploading (#3095)

  ByronHsu

  authored
  3ed0a54

  Copy full SHA for 3ed0a54

• bump router to 0.1.4 (#3094)

  ByronHsu

  authored
  8d8ef84

  Copy full SHA for 8d8ef84

• [router] Forward all request headers from router to workers (#3070)

  ByronHsu

  authored
  9a0cc2e

  Copy full SHA for 9a0cc2e

Commits on Jan 23, 2025

• [router] make error actionable (#3063)

  ByronHsu

  authored
  5de5065

  Copy full SHA for 5de5065

• [devcontainer] add non-root user (#2989)

  ByronHsu

  authored
  c0bf9bf

  Copy full SHA for c0bf9bf

Commits on Jan 20, 2025

• bump router to 0.1.3 (#3020)

  ByronHsu

  authored
  3ad4cd4

  Copy full SHA for 3ad4cd4

• [router] Expose worker startup interval (#3019)

  ByronHsu

  authored
  3a8428e

  Copy full SHA for 3a8428e

• [router] Expose worker startup secs & Return error instead of panic for router init (#3016)

  ByronHsu

  authored
  0311ce8

  Copy full SHA for 0311ce8

• [kernel] port rope cuda kernel to sgl-kernel (#2993)

  Show description for b5caa22
  

  ByronHsu

  and

  zhyncs

  authored
  b5caa22

  Copy full SHA for b5caa22

Commits on Jan 19, 2025

• [router] Fix sgl router path for release (#2980)

  ByronHsu

  authored
  4719c1d

  Copy full SHA for 4719c1d

• [router] Allow empty worker list for sglang.launch_router (#2979)

  ByronHsu

  authored
  ef18b0e

  Copy full SHA for ef18b0e

• [devcontainer] Fix mount and GPU & Support rust dev (#2978)

  ByronHsu

  authored
  53cc91e

  Copy full SHA for 53cc91e

Commits on Dec 11, 2024

• Update v0.1.0.md

  ByronHsu

  authored
  2d60a5e

  Copy full SHA for 2d60a5e

• [router] Release router 0.1.0 with dynamic scaling and fault tolerance (#2455)

  ByronHsu

  authored
  2e4a590

  Copy full SHA for 2e4a590

• [router] Update doc for dynamic scaling and fault tolerance (#2454)

  ByronHsu

  authored
  c0ee46f

  Copy full SHA for c0ee46f

• [router] remove main.rs because only lib.rs is used for py binding (#2453)

  ByronHsu

  authored
  864bf2b

  Copy full SHA for 864bf2b

• [router] Add retries based fault tolerance (#2452)

  ByronHsu

  authored
  a4cca7f

  Copy full SHA for a4cca7f

• [router] Use borrow if possible to save cost (#2441)

  ByronHsu

  authored
  0fb88aa

  Copy full SHA for 0fb88aa

• [router] Refactor: decouple select and send stage (#2440)

  ByronHsu

  authored
  d4de9a6

  Copy full SHA for d4de9a6

Commits on Dec 9, 2024

• reduce watchdog interval to 5s (#2410)

  ByronHsu

  authored
  27f7bed

  Copy full SHA for 27f7bed

• [router] add health checking in router init (#2393)

  ByronHsu

  authored
  6387098

  Copy full SHA for 6387098

• [Router] fix interrupt from terminal (#2413)

  ByronHsu

  authored
  2a717c5

  Copy full SHA for 2a717c5

Commits on Dec 8, 2024

• [router] Improve cleanup logic (#2411)

  ByronHsu

  authored
  a1e697b

  Copy full SHA for a1e697b

Commits on Dec 7, 2024

• [router] Health check on worker before adding to the router (#2392)

  ByronHsu

  authored
  ef995da

  Copy full SHA for ef995da

• [router] Add remove worker api (#2380)

  ByronHsu

  authored
  c36736c

  Copy full SHA for c36736c

Commits on Dec 6, 2024

• [router] add remove tenant method in the radix tree (#2379)

  ByronHsu

  authored
  1bf9e34

  Copy full SHA for 1bf9e34

• [Router] remove duplicate char count (#2378)

  ByronHsu

  authored
  499c85f

  Copy full SHA for 499c85f

• [router] support /add_worker api (#2369)

  ByronHsu

  authored
  67b6579

  Copy full SHA for 67b6579

• [router] use 2-gpu-runner (#2368)

  

  ByronHsu

  authored and

  zhyncs

  committed
  64fceab

  Copy full SHA for 64fceab

Commits on Dec 3, 2024

• [router] Copy license when publishing & bump version (#2339)

  ByronHsu

  authored
  0495796

  Copy full SHA for 0495796

Pagination

Previous

Next