Skip to content

Latest commit

 

History

History
27 lines (22 loc) · 915 Bytes

README.md

File metadata and controls

27 lines (22 loc) · 915 Bytes
Raw

ServerGemma

About API

Conf

  • I am using the Result of QSetting as the configuration file. So, If you are using the ServerGemma only, you can generate a configuration file first by the QT version or just wrote it manually. Like below:
  • 我使用了 QSetting 的结果作为配置文件。 如果你打算直接使用ServerGemma，可以考虑使用QT版本的gemma先生成一次配置 文件，或者直接手写一份。参照下面示例：
[Setting]
MaxGeneratedTokens=2048
MaxTokens=3072
Temperature=1.0
Verbosity=2
ModelType=2b-pt
Weight=/opt/gemma/CodeGemma/2b-pt-sfp.sbs
Tokenizer=/opt/gemma/CodeGemma/tokenizer.spm
WebSocketPort=9999