You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Some client already switched to max_completion_tokens.
Fixed by common\sampling.py:28 to "validation_alias=AliasChoices("max_tokens", "max_length", "max_completion_tokens"),"
Acknowledgements
I have looked for similar issues before submitting this one.
I have read the disclaimer, and this issue is related to a code bug. If I have a question, I will use the Discord server.
I understand that the developers have lives and my issue will be answered when possible.
I understand the developers of this program are human, and I will ask my questions politely.
The text was updated successfully, but these errors were encountered:
OS
Linux
GPU Library
CUDA 12.x
Python version
3.12
Describe the bug
Some client already switched to max_completion_tokens.
Fixed by common\sampling.py:28 to "validation_alias=AliasChoices("max_tokens", "max_length", "max_completion_tokens"),"
Acknowledgements
The text was updated successfully, but these errors were encountered: