Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add NIM flag logic #312

Open
wants to merge 17 commits into
base: incubating
Choose a base branch
from
Open

Add NIM flag logic #312

wants to merge 17 commits into from

Commits on Oct 25, 2024

  1. Restore fixed versions in params.env

    @hdefazio
    hdefazio committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    56ae3b4 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Add runtime template of vLLM ROCM (opendatahub-io#287) 

    Signed-off-by: Vaibhav Jain <vajain@redhat.com>
    @vaibhavjainwiz
    vaibhavjainwiz authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    828da6b View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Add runtime template of vLLM Gaudi (opendatahub-io#290) 

    Signed-off-by: Vaibhav Jain <vajain@redhat.com>
    @vaibhavjainwiz
    vaibhavjainwiz authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    479aece View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. [Cherry-Pick] vLLM multi-node template (opendatahub-io#292) 

    * [RHOAIENG-15386] add a new servingruntime vllm-multinode-template (opendatahub-io#284)

* add a new servingruntime vllm-multinode-template

Signed-off-by: jooho lee <jlee@redhat.com>

* follow up comments

Signed-off-by: jooho lee <jlee@redhat.com>

* follow up comments

Signed-off-by: jooho lee <jlee@redhat.com>

* follow up comments

Signed-off-by: jooho lee <jlee@redhat.com>

* follow up comments

Signed-off-by: jooho lee <jlee@redhat.com>

---------

Signed-off-by: jooho lee <jlee@redhat.com>

* Fix ServingRuntime args (opendatahub-io#291)

* fix runtime args

Signed-off-by: jooho lee <jlee@redhat.com>

* add disable_custom_all_reduce solving vllm-8735 issue

Signed-off-by: jooho lee <jlee@redhat.com>

---------

Signed-off-by: jooho lee <jlee@redhat.com>

---------

Signed-off-by: jooho lee <jlee@redhat.com>
    @Jooho
    Jooho authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    36ca97c View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. enhance probe to support rollingUpgrade (opendatahub-io#293) 

    Signed-off-by: jooho lee <jlee@redhat.com>
    @Jooho
    Jooho committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    37badd7 View commit details
    Browse the repository at this point in the history

  2. Merge pull request opendatahub-io#294 from Jooho/cp_15763 

    [Cherry-Pick] Enhance probe to support rollingUpgrade (opendatahub-io#293)
    @Jooho
    Jooho authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    898ebab View commit details
    Browse the repository at this point in the history

  3. enhance template not to use query for checking model health 

    Signed-off-by: jooho lee <jlee@redhat.com>
    @Jooho
    Jooho committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    e9a51d1 View commit details
    Browse the repository at this point in the history

  4. Merge pull request opendatahub-io#296 from Jooho/cp_vllm_final 

    [Cherry-pick] enhance template not to use query for checking model health
    @Jooho
    Jooho authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    44e33d6 View commit details
    Browse the repository at this point in the history

  5. fix typo 

    Signed-off-by: jooho lee <jlee@redhat.com>
    @Jooho
    Jooho committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    5a70abd View commit details
    Browse the repository at this point in the history

  6. Merge pull request opendatahub-io#298 from Jooho/fix_typo 

    [cherry-pick] fix typo
    @Jooho
    Jooho authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    107a36a View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Update caikit-tgis and ovms stable image (opendatahub-io#299) 

    Signed-off-by: rpancham <rpancham@redhat.com>
    @rpancham
    rpancham authored Nov 15, 2024
    Configuration menu
    Copy the full SHA
    c3b17b8 View commit details
    Browse the repository at this point in the history

  2. Pin vLLM images for Gaudi and ROCM 

    Signed-off-by: Edgar Hernández <23639005+israel-hdez@users.noreply.github.com>
    @israel-hdez
    israel-hdez committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    28d1d83 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into 0120-sync 

    Signed-off-by: Edgar Hernández <23639005+israel-hdez@users.noreply.github.com>
    @israel-hdez
    israel-hdez committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    fc8fde8 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Merge pull request opendatahub-io#302 from israel-hdez/0120-sync 

    Sync main -> release-0.12.0: Preparing ODH release
    @israel-hdez
    israel-hdez authored Nov 16, 2024
    Configuration menu
    Copy the full SHA
    8a19341 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. update global ca bundle logic and storage-config logic to follow up o… 

    …dh operator pr(1339) (opendatahub-io#308)

Signed-off-by: jooho lee <jlee@redhat.com>
    @Jooho
    Jooho committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    b5de317 View commit details
    Browse the repository at this point in the history

  2. Merge pull request opendatahub-io#309 from Jooho/cp_RHOAIENG-16070 

    [Cherry-Pick] update global ca bundle logic and storage-config logic
    @Jooho
    Jooho authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    516e192 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. Add NIM flag logic 

    Signed-off-by: mtrujillo <trujillo169@hotmail.com>
    @trujillm
    trujillm committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    0e9e122 View commit details
    Browse the repository at this point in the history