Skip to content

[Feature] I hope to increase user traffic control, and to limit the maximum number of tokens used by users within a specified time through tokens. Currently, only the number of client calls is limited. #3782

@kk545141

Description

@kk545141

MaxKB Version

v2.0

Please describe your needs or suggestions for improvements

希望增加用户流量控制,通过tokens形式,限定用户指定时间内最多使用的tokens数量,目前只有限制客户端调用次数。

例如,用户通过接口或频繁与助手交互时,需要限制其使用的模型tokens,避免模型资源被大量消耗。

Please describe the solution you suggest

No response

Additional Information

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions