Skip to content

Conversation

MuhammedSuhaib
Copy link

docs: clarify ModelSettings.truncation behavior

  • Expanded the docstring for ModelSettings.truncation.
  • Documented the behavior of:
    • "auto": drops middle conversation items if input exceeds context window, request still succeeds and streaming continues normally.
    • "disabled": (default) request fails with 400 if input exceeds context window.
    • None: defers to provider default (typically "disabled").
  • Aligns SDK docs with the official API reference.

@seratch
Copy link
Member

seratch commented Aug 24, 2025

The current one has the link to the document, so it should be sufficient. Also, we'd like to avoid duplicated list there for this property.

@seratch seratch closed this Aug 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants