Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3588上支持的Qwen类型 #2

Open
PlanetesDDH opened this issue Oct 28, 2024 · 2 comments
Open

3588上支持的Qwen类型 #2

PlanetesDDH opened this issue Oct 28, 2024 · 2 comments

Comments

@PlanetesDDH
Copy link

PlanetesDDH commented Oct 28, 2024

hello,看到你README中用到了Qwen2.5-3B-Instruct,但是rknn-llm 中显示只有Qwen2-1.5B,所以rknn-llm不是只支持1.5B而是其他的也可以?谢谢~

@wudingjian
Copy link
Owner

wudingjian commented Oct 28, 2024

是的

  sh -c "python3 gradio_server.py --target_platform rk3588 --rkllm_model_path /rkllm_server/model/Qwen2.5-3B.rkllm" #  rkllm模型文件名称自行修改

例如:Qwen2.5-3B.rkllm

rkllm模型下载链接:https://pan.baidu.com/s/1kIxv488-0IiQdZgDpKO-cw?pwd=up1b 提取码:up1b

https://huggingface.co/jsntwdj/rkllm

下载后的模型文件放在./model目录下

也可以自行转换

@PlanetesDDH
Copy link
Author

谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants