Skip to content

open ai + vllm 工具调用模型死循环不返回 #3793

Open
@jichengda

Description

@jichengda

哪位大佬可以帮我看一下这个问题。感谢
spring ai open ai + vllm 部署的模型。调用工具的时候不返回,一直在死循环。日志在最后面。
模型是Qwen3-32B,用ollama的时候是正常的。想换成vllm。

` @RequestMapping("chat")
public String chat(String question) {

    OpenAiApi api = OpenAiApi.builder()
            .apiKey("EMPTY")
            .baseUrl("http://ip:8001/")
            .build();

    ToolCallback[] dateTimeTools = ToolCallbacks.from(new DateTimeTools());
    OpenAiChatOptions options = OpenAiChatOptions.builder()
            .model("/Qwen3-32B")
            .toolCallbacks(dateTimeTools)
            .toolChoice("required")
            .build();

    OpenAiChatModel chatModel = OpenAiChatModel.builder()
            .openAiApi(api)
            .defaultOptions(options)
            .build();

    return chatModel.call(question);
}`

2025-07-11T17:57:13.195+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:13.198+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:13.199+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:13.199+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:14.889+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:14.889+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:14.890+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:14.890+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:16.125+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:16.125+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:16.126+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:16.126+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:17.465+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:17.465+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:17.466+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:17.466+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:18.885+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:18.886+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:20.213+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:20.213+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:20.214+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:20.214+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:21.644+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:21.645+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:24.103+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:24.103+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:24.104+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:24.104+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:25.329+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:25.330+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:25.330+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:25.331+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:26.531+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:27.786+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:27.786+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:27.787+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:27.787+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:29.136+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:29.137+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:29.138+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:29.138+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON. 2025-07-11T17:57:30.451+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.m.tool.DefaultToolCallingManager : Executing tool call: getCurrentDateTime 2025-07-11T17:57:30.451+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Starting execution of tool: getCurrentDateTime 2025-07-11T17:57:30.452+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.ai.tool.method.MethodToolCallback : Successful execution of tool: getCurrentDateTime 2025-07-11T17:57:30.452+08:00 DEBUG 79865 --- [ai-energy-report] [nio-8080-exec-1] o.s.a.t.e.DefaultToolCallResultConverter : Converting tool result to JSON.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions