Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added logprobs handling in choice response and user can get the logit… #1236

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Added logprobs handling in choice response and user can get the logit… #1236

wants to merge 4 commits into from
+44 −2

Commits on Nov 28, 2024

  1. Added logprobs handling in choice response and user can get the logit… 

    …s of the tokens when use vllm to deploy local model
    @hengzzzhou
    hengzzzhou committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    88a9d10 View commit details
    Browse the repository at this point in the history

  2. Update chat_agent.py

    @hengzzzhou
    hengzzzhou authored Nov 28, 2024
    Configuration menu
    Copy the full SHA
    bce4a8d View commit details
    Browse the repository at this point in the history

  3. Update vllm_config.py

    @hengzzzhou
    hengzzzhou authored Nov 28, 2024
    Configuration menu
    Copy the full SHA
    94a165d View commit details
    Browse the repository at this point in the history

  4. Update agent_responses.py

    @hengzzzhou
    hengzzzhou authored Nov 28, 2024
    Configuration menu
    Copy the full SHA
    3f51f15 View commit details
    Browse the repository at this point in the history