Description
哪位大佬可以帮我看一下这个问题。感谢
spring ai open ai + vllm 部署的模型。调用工具的时候不返回,一直在死循环。日志在最后面。
模型是Qwen3-32B,用ollama的时候是正常的。想换成vllm。
` @RequestMapping("chat")
public String chat(String question) {
OpenAiApi api = OpenAiApi.builder()
.apiKey("EMPTY")
.baseUrl("http://ip:8001/")
.build();
ToolCallback[] dateTimeTools = ToolCallbacks.from(new DateTimeTools());
OpenAiChatOptions options = OpenAiChatOptions.builder()
.model("/Qwen3-32B")
.toolCallbacks(dateTimeTools)
.toolChoice("required")
.build();
OpenAiChatModel chatModel = OpenAiChatModel.builder()
.openAiApi(api)
.defaultOptions(options)
.build();
return chatModel.call(question);
}`
2025-07-11T17:57:13.195+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:13.198+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:13.199+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:13.199+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:14.889+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:14.889+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:14.890+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:14.890+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:16.125+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:16.125+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:16.126+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:16.126+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:17.465+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:17.465+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:17.466+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:17.466+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:18.885+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:20.213+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:20.213+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:20.214+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:20.214+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:21.645+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:24.103+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:24.103+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:24.104+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:24.104+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:25.329+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:25.330+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:25.330+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:25.331+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:27.786+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:27.786+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:27.787+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:27.787+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:29.136+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:29.137+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:29.138+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:29.138+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:30.451+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:30.451+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:30.452+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:30.452+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON.