Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add benchmarks API-Bank, APIBench, Nexus #1136

Merged
merged 48 commits into from
Dec 29, 2024
Merged
Show file tree
Hide file tree
Changes from 41 commits
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
713a2d2
add benchmark gorilla, nexus
HHHHHejia Oct 30, 2024
9398ffb
add apibank
HHHHHejia Nov 1, 2024
f8ba0d7
Merge branch 'master' into benchmark_hejia
harryeqs Nov 19, 2024
5352cea
Merge branch 'master' into benchmark_hejia
harryeqs Nov 24, 2024
f6d3436
Merge branch 'master' into benchmark_hejia
harryeqs Nov 25, 2024
638dc57
Convert gorilla and nexusraven to regular directories
HHHHHejia Nov 26, 2024
679225e
Merge branch 'master' into benchmark_hejia
harryeqs Dec 2, 2024
1c113d1
refactor: Constructed NexusBenchmark following BaseBenchmark from GAI…
harryeqs Dec 4, 2024
ca1e490
Merge branch 'master' into benchmark_hejia
harryeqs Dec 4, 2024
b5a7d0b
Merge branch 'master' into benchmark_hejia
harryeqs Dec 5, 2024
9083048
refactor: Refactored the integration of APIBench (Gorilla) benchmark
harryeqs Dec 6, 2024
1b151e0
Merge branch 'master' into benchmark_hejia
harryeqs Dec 6, 2024
14ee80a
refactor: Modified code structure
harryeqs Dec 7, 2024
42b7407
refactor: Integrated APIBank
harryeqs Dec 8, 2024
f908681
refactor: Change directory name for smoother merge
harryeqs Dec 8, 2024
9a77c78
Merge branch 'master' into benchmark_hejia
harryeqs Dec 8, 2024
0d71313
docs: Update docs and put into benchmarks directory
harryeqs Dec 9, 2024
7745c37
docs: Included examples
harryeqs Dec 9, 2024
8ad922a
update poetry lock
harryeqs Dec 9, 2024
acd676c
fix: Fix tree_sitter_import issue
harryeqs Dec 9, 2024
1511711
Merge branch 'master' into benchmark_hejia
harryeqs Dec 9, 2024
5a26acf
update poetry lock
harryeqs Dec 9, 2024
68c4e30
update poetry lock
harryeqs Dec 9, 2024
7c427ce
clean code for upcoming refactoring
harryeqs Dec 10, 2024
4730c16
Merge branch 'master' into benchmark_hejia
harryeqs Dec 10, 2024
bc057ab
fix tests
harryeqs Dec 11, 2024
0cce601
Merge branch 'benchmark_hejia' of https://github.com/HHHHHejia/camel …
harryeqs Dec 11, 2024
b757d8d
updated download method for APIBank benchmark
harryeqs Dec 11, 2024
03221e1
updated APIBench download and eval_ast
harryeqs Dec 11, 2024
2f52186
Merge branch 'master' into benchmark_hejia
harryeqs Dec 11, 2024
0e942ef
updated docstrings
harryeqs Dec 12, 2024
35f2afa
Merge branch 'master' into benchmark_hejia
harryeqs Dec 12, 2024
ad777cf
updated docstrings
harryeqs Dec 12, 2024
ded55bf
Merge branch 'master' into benchmark_hejia
harryeqs Dec 14, 2024
83805f0
update type annotations
harryeqs Dec 14, 2024
f534efe
clean code and update docstrings
harryeqs Dec 15, 2024
1eab6e3
Merge branch 'master' into benchmark_hejia
harryeqs Dec 15, 2024
34e33cf
Merge branch 'master' into benchmark_hejia
harryeqs Dec 16, 2024
1d280a9
Merge branch 'master' into benchmark_hejia
harryeqs Dec 17, 2024
41fe3ed
Merge branch 'master' into benchmark_hejia
harryeqs Dec 18, 2024
9a0dba3
update pyproject.toml and poetry.lock
harryeqs Dec 18, 2024
a367501
Merge branch 'master' into benchmark_hejia
harryeqs Dec 19, 2024
a5127f9
improve structure and add unit tests
harryeqs Dec 23, 2024
511fbe0
Merge branch 'master' into benchmark_hejia
harryeqs Dec 23, 2024
f3da00c
resolve conflicts
harryeqs Dec 23, 2024
8907b94
update poetry.lock
harryeqs Dec 23, 2024
c38f619
Merge branch 'master' into benchmark_hejia
harryeqs Dec 27, 2024
d2b7e9d
Merge branch 'master' into benchmark_hejia
Wendong-Fan Dec 29, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 11 additions & 1 deletion camel/benchmarks/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,5 +14,15 @@

from .base import BaseBenchmark
from .gaia import DefaultGAIARetriever, GAIABenchmark
from .nexus import NexusBenchmark
from .apibank import APIBankBenchmark
from .apibench import APIBenchBenchmark

__all__ = ["BaseBenchmark", "GAIABenchmark", "DefaultGAIARetriever"]
__all__ = [
"BaseBenchmark",
"GAIABenchmark",
"DefaultGAIARetriever",
"NexusBenchmark",
"APIBenchBenchmark",
"APIBankBenchmark",
]
Loading
Loading