[Roadmap] Tools and APIs Integration

[lightaime]

Motivation

The ability to call tools would enhance CAMEL's ability and be handy for developers. Here are some tools we prioritize to integrate. Some of them are suggested by GPT-4:

• Search tools: Google API (feat: add web search #274), Wikipedia: (Integrate OpenAI Function Calling API #213)
• Python interpreter (feat: python interpreter #182)
• HuggingFace Agent (Add BaseAgent, EmbodiedAgent, BaseToolAgent, HuggingFaceToolAgent and full and fast test mode (#123) #123)
• Function Call ([Feature Request] OpenAI function call #187)
• Weather API (@yiyiyi0817, Weather API - OpenWeatherMap)
• Github @Wendong-Fan [Feature Request] integrate github into CAMEL functions #544
• WolframAlpha (Add Wolfram|Alpha Query Feature via search_wolfram_alpha api #494)
• UnstructuredIO
• Google Map
• Google Drive API
• Twitter API @yiyiyi0817 ([Feature Request] Twitter API #500)
• Discord API @Wendong-Fan [Feature Request] integrate Discord into CAMEL functions #545
• WeChat API
• WhatsApp API
• Facebook Graph API
• Youtube Data api
• Zoom API
• Spotify API
• Twilio API
• Slack API @Wendong-Fan [Feature Request] integrate Slack into CAMEL functions #546
• Shopify API
• Resend
• SendGrid API
• Reddit API
• Airtable API
• Yelp API
• TripAdvisor API
• Skyscanner API
• Booking.com API
• Text-to-image feat: Support multi-modal input and multi-modal output in one agent #529
• Text-to-speech @Wendong-Fan [Feature Request] integrate text to speech model #547
• LangChain Agent
• Duckduck go search @jjyaoao feat: add duckduckgo search and enhance the text extraction from the website #440
• Gorilla Agent ([WIP] Add Gorilla tool agent #146)
• Terminal
• Docker
• OpenCV
• Notion @Wendong-Fan
• Figma @Wendong-Fan

[marchowardbegins]

This would be great @lightaime . A use case would be for the user to directly chat with the assistant instead of the user being automated. For example currently CAMEL can simulate a great conversation between an accountant and a business owner. However if the business owner could be prompted with the right questions to answer to maximize his tax savings that would be a great coaching feature. Lmk if this fits here or if perhaps should be in a separate roadmap issue.

[lightaime]

This would be great @lightaime . A use case would be for the user to directly chat with the assistant instead of the user being automated. For example currently CAMEL can simulate a great conversation between an accountant and a business owner. However if the business owner could be prompted with the right questions to answer to maximize his tax savings that would be a great coaching feature. Lmk if this fits here or if perhaps should be in a separate roadmap issue.

Thank @marchowardbegins for the comments. I created a separate road map for adding more chat modes: #59.

[ElliotWood]

LangChain Agent and Tool/Toolkit integration would add a lot of capability (35+ tools)

[lightaime]

@riverfor are you interested in tasks such as supporting tools like terminal, docker and github?