Gemma.WS

The core of this repo is ServerGemma. It's a Gemma server basic on WebSocket, json and GemmaC++.

本工程的核心部分是 ServerGemma。 基于WebSocket 、 json 和 GemmaC++ 搭建而成。

Functions

• Gemma.QT is one of the developing client based on QT UI Framework.

  • Gemma.QT 是基于QT图形框架的 Gemma 聊天机器人客户端。

• Coding assistant based on Code Gemma for Sublime Text.

  • 基于 WebSocket 的 CodeGemma Sublime Text 编程助手；

• Developing...

  • 开发中……

Build & Run

Visit the Gemma model page on Kaggle and select Model Variations|> Gemma C++. Download the 2b-it-sfp model and decompress.

Run ./travis.sh to compile and run.

Note: If you want to use the weight-file without sfp, add -DWEIGHT_TYPE=hwy::bfloat16_t to cmake command.