Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate on Criteria or Divan for benchmarking #344

Open
gatesn opened this issue Jun 9, 2024 · 5 comments
Open

Consolidate on Criteria or Divan for benchmarking #344

gatesn opened this issue Jun 9, 2024 · 5 comments

Comments

@gatesn
Copy link
Contributor

gatesn commented Jun 9, 2024

No description provided.

@AdamGS
Copy link
Contributor

AdamGS commented Jun 24, 2024

My 2c here - I wished I could fork Criterion multiple times, and it seems like Divan is actually maintained which is a big plus in my book

@robert3005
Copy link
Member

I agree with your point. Seeing criterion have 23 open prs is not a good look for a project with a well defined functionality

@gatesn
Copy link
Contributor Author

gatesn commented Jun 27, 2024

Only issue I see atm is that Divan doesn't support async benchmarks? Any ideas how to workaround @AdamGS ?

@AdamGS
Copy link
Contributor

AdamGS commented Jun 28, 2024

The first thing I would try is to create the runtime as part of the setup, and then call Runtime::block_on or it's equivalent in the actual benchmark code.
From reading the docs seems like there are some threading-related configs you might have to use, and hopefully everything will play nice together.

@nvzqz
Copy link

nvzqz commented Jun 30, 2024

Hi! I plan to prioritize async benchmarks after I ship JSON output. 🙂 Follow nvzqz/divan#39 for updates

From reading the docs seems like there are some threading-related configs you might have to use, and hopefully everything will play nice together.

That's separate and unrelated from async. Multi-threaded benchmarks are more so for measuring contention on locks and atomics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants