-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Switch to upstream vLLM #22
Comments
/assign @coolkp |
@liu-cong: GitHub didn't allow me to assign the following users: coolkp. Note that only kubernetes-sigs members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
/assign @coolkp |
@coolkp: GitHub didn't allow me to assign the following users: bot, assign, to, me. Note that only kubernetes-sigs members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
We used a forked vLLM for POC for additional metrics not available in vLLM. With https://github.com/vllm-project/vllm/pull/9477/files, we have the required LoRA metrics in vLLM. This issue involves the following tasks:
The text was updated successfully, but these errors were encountered: