Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why fixed temperature at 1 for Claude 3.7? #108

Closed
IS2511 opened this issue Mar 5, 2025 · 2 comments
Closed

Why fixed temperature at 1 for Claude 3.7? #108

IS2511 opened this issue Mar 5, 2025 · 2 comments

Comments

@IS2511
Copy link

IS2511 commented Mar 5, 2025

https://github.com/LostRuins/lite.koboldai.net/blob/db0d04071665978b7eecf5937ff5c33eb55d8e15/index.html#L14640-L14648

What is the reason for that claude_payload.temperature = 1;? 🤔 I can't seem to find anything in the docs that would suggest the need to hold the temperature at 1.

Suggested issue tags: question, bug

@LostRuins
Copy link
Owner

Not a bug, claude forces it.
It will refuse to generate if you don't use temp = 1 when using thinking.
Temp 1 is only forced if thinking mode is selected.

@IS2511
Copy link
Author

IS2511 commented Mar 6, 2025

My bad, found it. I don't know how I missed it...

https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#important-considerations-when-using-extended-thinking

Thinking isn’t compatible with temperature, top_p, or top_k modifications as well as forced tool use.

Suggested issue tags: question

@IS2511 IS2511 closed this as completed Mar 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants