You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If we can record the server config as part of the benchmark data via this endpoint, this would make life a whole lot easier to compare across runs.
The feature implementation for this would also require to check for the availability for the endpoint considering this is an optional endpoint.
The text was updated successfully, but these errors were encountered:
thameem-abbas
changed the title
[Feature Request] Support for /server_info endpoint when vLLM 0.9.0 lands
[Feature Request] Record server config from /server_info endpoint when vLLM 0.9.0 lands
May 19, 2025
If we can record the server config as part of the benchmark data via this endpoint, this would make life a whole lot easier to compare across runs.
The feature implementation for this would also require to check for the availability for the endpoint considering this is an optional endpoint.
Reference to the vLLM issue : vllm-project/vllm#16572
The text was updated successfully, but these errors were encountered: