Replies: 1 comment
-
Seems to be working fine for me. I'm using chat completions through tabbyAPI. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I tried ExLlamaV2 of Qwen 2 7b, but the output is gibberish. There is a discussion over at llama.cpp: ggerganov/llama.cpp#7805
Beta Was this translation helpful? Give feedback.
All reactions