Skip to content

Implement guidellm UI #169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: implement-app-tooling
Choose a base branch
from

Conversation

DaltheCow
Copy link
Contributor

This PR actually implements the application logic including the UI/charts and the api setup that retrieves data from the window object.

@DaltheCow DaltheCow added the UI Front-end workstream label May 19, 2025
@DaltheCow DaltheCow changed the base branch from main to implement-app-tooling May 19, 2025 21:22

1. Use the Hosted Build (Recommended for Most Users)

After running a benchmark with GuideLLM, a report.html file will be generated (by default at guidellm_report/report.html). This file references the latest stable version of the UI hosted at:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is based off of a WIP effort i have. I don't know if this is where report.html will end up but that is what I'm working with for now.

📦 Build Artifacts Available
The build artifacts (.whl and .tar.gz) have been successfully generated and are available for download: https://github.com/neuralmagic/guidellm/actions/runs/15123450667/artifacts/3155185784.
They will be retained for up to 30 days.

npx serve out
```

This will start a local server (e.g., at http://localhost:3000). Then, in your GuideLLM config or CLI flags, point to this local server as the asset base for report generation.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not something I've set up yet. Currently in this file the asset bases are configured via environment. One for prod, staging, dev, and local. But what I have in the readme implies you can see it to something other than the preconfigured options. Maybe it'd be better to have local hardcoded to localhost:3000 and wait on adding an option for the user to configure. Not sure.


### 🚧 Future Possibilities

We're evaluating options for hosting dev/staging/prod builds on GitHub Pages. For now, production builds will be published at:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should go with GitHub pages. I just left the other ideas in there as food for thought since gh pages is being used for docs right now, but I think these things can coexist. Netlify seems like something common in OS repos, and this is currently a Next.js app so Vercel also seems like a reasonable choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
UI Front-end workstream
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant