Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run weave locally and/or without wandb API key #3111

Open
HarshTrivedi opened this issue Nov 29, 2024 · 3 comments
Open

Run weave locally and/or without wandb API key #3111

HarshTrivedi opened this issue Nov 29, 2024 · 3 comments

Comments

@HarshTrivedi
Copy link

Thanks for the great work!

  1. Can I store the traced LLM call logs locally in a file/directory of my choice instead of wandb servers?
  2. If yes, can I also run weave without a wand API key, as everything is done locally?

If not, are you aware of any alternative library that supports tracing and saving locally?

@andrewtruong
Copy link
Collaborator

Hey @HarshTrivedi , thanks! We might have a fully local (maybe sqlite based) version someday, but it's not a focus atm.

@HarshTrivedi
Copy link
Author

@andrewtruong That would be really cool!

I want to patch the portion of the weave code that submits to wandb server and, instead, make it save to local file/s. Do you think this is doable? If so, can you point me to relevant code/functions I should look at?

If you can somehow expose a hook or callback for custom logic one might want to apply before/after the LLM call, I think it could also be useful for other things outside of local/custom storage.

@fnl
Copy link

fnl commented Dec 5, 2024

So wandb local would not be sufficient to use Weave locally?

What I am trying to figure out is Weave supports a local, virtual private cloud mode alike Braintrust.dev

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants