We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hello,看到你README中用到了Qwen2.5-3B-Instruct,但是rknn-llm 中显示只有Qwen2-1.5B,所以rknn-llm不是只支持1.5B而是其他的也可以?谢谢~
The text was updated successfully, but these errors were encountered:
是的
sh -c "python3 gradio_server.py --target_platform rk3588 --rkllm_model_path /rkllm_server/model/Qwen2.5-3B.rkllm" # rkllm模型文件名称自行修改
例如:Qwen2.5-3B.rkllm
rkllm模型下载链接:https://pan.baidu.com/s/1kIxv488-0IiQdZgDpKO-cw?pwd=up1b 提取码:up1b
https://huggingface.co/jsntwdj/rkllm
下载后的模型文件放在./model目录下
也可以自行转换
Sorry, something went wrong.
谢谢!
No branches or pull requests
hello,看到你README中用到了Qwen2.5-3B-Instruct,但是rknn-llm 中显示只有Qwen2-1.5B,所以rknn-llm不是只支持1.5B而是其他的也可以?谢谢~
The text was updated successfully, but these errors were encountered: