Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Commit

Permalink
add qwen2 extension test
Browse files Browse the repository at this point in the history
  • Loading branch information
sys-lpot-val committed Jul 1, 2024
1 parent 97c8190 commit 5255453
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions tests/model-test/cpp_graph_inference.sh
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,7 @@ model_name_map["baichuan2-13b"]="baichuan-inc/Baichuan2-13B-Chat"
model_name_map["baichuan-13b"]="baichuan-inc/Baichuan-13B-Chat"
model_name_map["mistral-7b"]="mistralai/Mistral-7B-v0.1"
model_name_map["qwen-7b"]="Qwen/Qwen-7B-Chat"
model_name_map["qwen2-7b"]="Qwen/Qwen2-7B"
model_name_map["magicoder"]="ise-uiuc/Magicoder-S-DS-6.7B"
model_name_map["whisper"]="openai/whisper-tiny"
model_name_map["phi2"]="microsoft/phi-2"
Expand Down Expand Up @@ -292,6 +293,10 @@ function main() {
quant_script="./build/bin/quant_qwen"
convert_script="${convert_script}/convert_qwen.py"
infer_cmd="./build/bin/run_qwen"
elif [[ "${model}" == "qwen2-7b" ]]; then
       quant_script="./build/bin/quant_qwen"
       convert_script="${convert_script}/convert_qwen.py"
       infer_cmd="./build/bin/run_qwen"
elif [[ "${model}" == "qwen-1_5" ]]; then
quant_script="./build/bin/quant_qwen"
convert_script="${convert_script}/convert_qwen.py"
Expand Down

0 comments on commit 5255453

Please sign in to comment.